-- Logs begin at Sat 2022-08-06 00:26:31 UTC, end at Sat 2022-08-06 01:38:18 UTC. -- Aug 06 01:06:25.223034 dv-cinder-851996-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 01:06:25 2022] *** Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: nodename: dv-cinder-851996-2-smb Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: machine: x86_64 Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: clock source: unix Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: pcre jit disabled Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: detected number of CPU cores: 4 Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: current working directory: / Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: detected binary path: /usr/bin/uwsgi-core Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: your processes number limit is 47680 Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: your memory page size is 4096 bytes Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: detected max file descriptor number: 2048 Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: lock engine: pthread robust mutexes Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: thunder lock: enabled Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 06 01:06:25.235707 dv-cinder-851996-2-smb devstack@keystone.service[80168]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 01:06:25.272471 dv-cinder-851996-2-smb devstack@keystone.service[80168]: Python main interpreter initialized at 0x55c826e899c0 Aug 06 01:06:25.272471 dv-cinder-851996-2-smb devstack@keystone.service[80168]: python threads support enabled Aug 06 01:06:25.272471 dv-cinder-851996-2-smb devstack@keystone.service[80168]: your server socket listen backlog is limited to 100 connections Aug 06 01:06:25.272471 dv-cinder-851996-2-smb devstack@keystone.service[80168]: your mercy for graceful operations on workers is 90 seconds Aug 06 01:06:25.272813 dv-cinder-851996-2-smb devstack@keystone.service[80168]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 01:06:25.272888 dv-cinder-851996-2-smb devstack@keystone.service[80168]: *** Operational MODE: preforking *** Aug 06 01:06:25.273156 dv-cinder-851996-2-smb devstack@keystone.service[80168]: *** uWSGI is running in multiple interpreter mode *** Aug 06 01:06:25.273156 dv-cinder-851996-2-smb devstack@keystone.service[80168]: spawned uWSGI master process (pid: 80168) Aug 06 01:06:25.273347 dv-cinder-851996-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 06 01:06:25.275155 dv-cinder-851996-2-smb devstack@keystone.service[80168]: spawned uWSGI worker 1 (pid: 80180, cores: 1) Aug 06 01:06:25.275155 dv-cinder-851996-2-smb devstack@keystone.service[80168]: spawned uWSGI worker 2 (pid: 80181, cores: 1) Aug 06 01:06:25.275155 dv-cinder-851996-2-smb devstack@keystone.service[80168]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 01:06:30.656998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:06:30.656998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: from cryptography.utils import int_from_bytes Aug 06 01:06:30.657834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:06:30.657834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Aug 06 01:06:30.658283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:06:30.658283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: from cryptography.utils import int_from_bytes Aug 06 01:06:30.658398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 01:06:30.658398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: from cryptography.utils import int_from_bytes Aug 06 01:06:30.707160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:06:30.707353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 01:06:30.707353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:06:30.707502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 01:06:30.707563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] command line args: [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:06:30.707625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] command line args: [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 01:06:30.707771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:06:30.707856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 01:06:30.707917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ================================================================================ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:06:30.707978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ================================================================================ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 01:06:30.708182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.708313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] admin_token = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.708402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config_dir = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.708469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_dir = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.708602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.708750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.708750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] config_source = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.708967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] config_source = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] debug = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] debug = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.709960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_config_append = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_config_append = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.710949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_dir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_dir = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.711875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.712940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.713074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.713155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.713334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.713457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.713521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.713587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.713811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.714006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.714101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.714162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.714237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.714298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.714539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.714667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715230 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] publish_errors = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] publish_errors = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.715879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716152 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] standard_threads = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] standard_threads = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.716970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_journal = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_journal = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_json = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_json = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_stderr = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_stderr = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] use_syslog = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] use_syslog = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.717958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.718049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 01:06:30.718212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.718288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.718445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.718522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.718702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.718791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.718935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.719969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720858 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.720937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.721900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.722878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.723867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.724974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.725918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.726923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.727892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.728969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.729991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.730933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.731935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.732996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.733899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.734906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.735841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.736944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.737977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.738945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.739864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.740919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.741915 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.742933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.external = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.external = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.743945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.password = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.password = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] auth.token = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] auth.token = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.744949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.745953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.746938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.747927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.748966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.749922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.750938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.751989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.752924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.753988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.754116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.754218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.754329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.754495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.754651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.754784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.754882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.755087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.756867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.756966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757683 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.757829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.758958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.759921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.760924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.761920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.762920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.763985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.764980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.765918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.766975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.767987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.768100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.768346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.768469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.768546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.768617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.768808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.768931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769848 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.769953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.770964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.771930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.772079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.772162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.772331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.772565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.772645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.772800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.772884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.773997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.774952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.775970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.776930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.777896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.778869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.779980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.780938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.781891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.782995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.783942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.784958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.785917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.786101 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.786538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.786704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.786781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.786996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.787933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.788928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.789980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.790903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.791847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792471 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.792935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.793010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.793089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:06:30.793161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.793391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 01:06:30.793556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 01:06:30.822109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.822339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.822561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.822648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.822799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.823001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.830896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.831238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.860643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.860895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.860988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.861077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.912721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.913014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.962985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.963195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.964047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:30.964280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.027963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.028036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.028110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.051452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.051692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.051891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.052863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.053018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.053225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.063792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.064013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.076524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.076747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.076987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80180) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.077976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.078140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.078363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80181) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 06 01:06:31.094601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.094815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:06:31.094937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.095150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:06:31.095319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.095319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:06:31.095543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.095620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.095682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 06 01:06:31.095795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.095881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.096082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.096206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.096339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.096420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.096627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.105966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.106253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.106375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.106505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.106587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.106776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.106898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.107034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.113599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.113842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.118293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.118440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.118578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.118747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.118876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.119933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.120899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.121097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.143579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.144102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.145050 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.145328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.145562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.145838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.149964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.150284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.150515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.150639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.150774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.151061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.157647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.157922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.158540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.158831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.162391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.162671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.162944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.163216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.163379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.163495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.163663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.163756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.163963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.164128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.164229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.164308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.164514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.164793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.165055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.165316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.180413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.180686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.181082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.181359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.184552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.185268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.187659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.187947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.188412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.188700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.192289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.193052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.195644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.196435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.198780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.199072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.199368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.199583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.199708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.199845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.199939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.200145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.200271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.200406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.200682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.200964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.215979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.216267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.216497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.216784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.216909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.217057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.217357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.217627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.224472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.224598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.225987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.226119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.226242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.226461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.229193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.229319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.229524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.229617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.229742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.229822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.230080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.230275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.230369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.230497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.241832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.241981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.242199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.242288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.242423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.242504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.242651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.242733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.242883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.242972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.243182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.243306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.243464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.243599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.258803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.258980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.261745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.261893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.264666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.264792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.267172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.267299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.268661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.268788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.268927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.269008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.269208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.269410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.275667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.275792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.277357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.277478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.280215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.280406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.280503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.280705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.280875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.280962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.281097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.281210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.289363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.289572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.289672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.289798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.289902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.290123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.296693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80180) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.296889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80181) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 06 01:06:31.297020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.297229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.297355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.297498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.297622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.297743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.297874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.298872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.299118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.299353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.299495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.299627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.299755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.299880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.300026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.300153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.300279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.300404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80180) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.300532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80181) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 06 01:06:31.333169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c826e899c0 pid: 80181 (default app) Aug 06 01:06:31.333315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c826e899c0 pid: 80180 (default app) Aug 06 01:06:31.336605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923d7d-a91e-4738-89f1-a840fb9793f8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:31.336890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923d7d-a91e-4738-89f1-a840fb9793f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:31.337161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b923d7d-a91e-4738-89f1-a840fb9793f8 None None] PATH_INFO: `/v3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:31.341538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Sat Aug 6 01:06:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:38.982266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b6d5-402a-48b6-9d5b-97b1838269f3 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:38.983167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b6d5-402a-48b6-9d5b-97b1838269f3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:38.983167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686b6d5-402a-48b6-9d5b-97b1838269f3 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:38.990390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:38.998903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:38.999372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:38.999464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:39.073434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: INFO dbcounter [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] Registered counter for database keystone Aug 06 01:06:39.094862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG oslo_db.sqlalchemy.engines [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:06:39.103947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writer thread running {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:06:39.286136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80181) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 01:06:39.286511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG passlib.handlers.bcrypt [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80181) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 01:06:39.341644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:39.343293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:39.476669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 06 01:06:39.625678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686b6d5-402a-48b6-9d5b-97b1838269f3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:39.703637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: INFO dbcounter [None req-4686b6d5-402a-48b6-9d5b-97b1838269f3 None None] Registered counter for database keystone Aug 06 01:06:39.728337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG oslo_db.sqlalchemy.engines [None req-4686b6d5-402a-48b6-9d5b-97b1838269f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 01:06:39.740361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writer thread running {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 01:06:39.859250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686b6d5-402a-48b6-9d5b-97b1838269f3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:39.864863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e19364-018e-4de7-99d9-e3be727bdeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:39.865513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19364-018e-4de7-99d9-e3be727bdeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:39.865798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19364-018e-4de7-99d9-e3be727bdeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:39.866106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e19364-018e-4de7-99d9-e3be727bdeb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:39.875323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e19364-018e-4de7-99d9-e3be727bdeb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:39.926681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b1e19364-018e-4de7-99d9-e3be727bdeb7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 01:06:39.926992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e19364-018e-4de7-99d9-e3be727bdeb7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:39.937441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Aug 6 01:06:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:06:39.945148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:39.969648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c9208-6fb5-4e30-8ac0-2ac09e6b05c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:39.977640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab09ed-b5e4-4997-9b9d-b71787158180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:39.978825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab09ed-b5e4-4997-9b9d-b71787158180 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:39.979112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab09ed-b5e4-4997-9b9d-b71787158180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:39.979390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab09ed-b5e4-4997-9b9d-b71787158180 admin admin] PATH_INFO: `/v3/projects/d85d95c8bfc045dbb053756109fbe722` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:39.981037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab09ed-b5e4-4997-9b9d-b71787158180 admin admin] RBAC: Authorizing `identity:get_project(project_id=d85d95c8bfc045dbb053756109fbe722)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:40.030860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dcab09ed-b5e4-4997-9b9d-b71787158180 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 06 01:06:40.031434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab09ed-b5e4-4997-9b9d-b71787158180 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:40.036238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Sat Aug 6 01:06:39 2022] GET /identity/v3/projects/d85d95c8bfc045dbb053756109fbe722 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:41.986758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2694b95-4d67-4e29-9a34-108c05d50908 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:41.987325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2694b95-4d67-4e29-9a34-108c05d50908 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:41.987325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2694b95-4d67-4e29-9a34-108c05d50908 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:41.991572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:41.998220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118881a5-5f5f-4a57-888d-e6ce9f07e2c7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:41.998949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118881a5-5f5f-4a57-888d-e6ce9f07e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:41.999089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118881a5-5f5f-4a57-888d-e6ce9f07e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:42.028835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-118881a5-5f5f-4a57-888d-e6ce9f07e2c7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:42.030407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-118881a5-5f5f-4a57-888d-e6ce9f07e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:42.040806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 06 01:06:42.073187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2694b95-4d67-4e29-9a34-108c05d50908 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:42.087838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2694b95-4d67-4e29-9a34-108c05d50908 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:42.093261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d9893-20b0-49d0-b718-b86a977a9aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:42.093869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d9893-20b0-49d0-b718-b86a977a9aef admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:42.094179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d9893-20b0-49d0-b718-b86a977a9aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:42.094440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d9893-20b0-49d0-b718-b86a977a9aef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:42.103105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d9893-20b0-49d0-b718-b86a977a9aef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:42.104918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d9893-20b0-49d0-b718-b86a977a9aef admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:42.114267 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Sat Aug 6 01:06:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:06:42.119710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118881a5-5f5f-4a57-888d-e6ce9f07e2c7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:42.129669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118881a5-5f5f-4a57-888d-e6ce9f07e2c7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:42.134515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c22af-2e5b-4d6c-875b-226b74aea87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:42.135162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c22af-2e5b-4d6c-875b-226b74aea87e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:42.135446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c22af-2e5b-4d6c-875b-226b74aea87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:42.135722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c22af-2e5b-4d6c-875b-226b74aea87e admin admin] PATH_INFO: `/v3/users/e1e471e155f146cdb2493555b6df58b4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:42.137202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c22af-2e5b-4d6c-875b-226b74aea87e admin admin] RBAC: Authorizing `identity:get_user(user_id=e1e471e155f146cdb2493555b6df58b4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:42.139110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c22af-2e5b-4d6c-875b-226b74aea87e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:42.140674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Sat Aug 6 01:06:42 2022] GET /identity/v3/users/e1e471e155f146cdb2493555b6df58b4 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:44.179974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b860-cc91-453d-abe9-24f436b7a5dd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.180539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b860-cc91-453d-abe9-24f436b7a5dd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.180539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78b860-cc91-453d-abe9-24f436b7a5dd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.181840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:44.187162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0f00-5445-4277-8d9f-85500b9a695d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.187604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0f00-5445-4277-8d9f-85500b9a695d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.187682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb0f00-5445-4277-8d9f-85500b9a695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.193841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957f30-5058-47e2-867b-d7734ca4b76c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.194126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957f30-5058-47e2-867b-d7734ca4b76c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.194428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73957f30-5058-47e2-867b-d7734ca4b76c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.195715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:44.200636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.200923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.201203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.207411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-08bb0f00-5445-4277-8d9f-85500b9a695d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:44.208679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-08bb0f00-5445-4277-8d9f-85500b9a695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:44.243517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG passlib.handlers.bcrypt [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80180) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 06 01:06:44.243962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG passlib.handlers.bcrypt [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80180) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 06 01:06:44.289241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:44.290867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:44.291947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:44.314816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0f00-5445-4277-8d9f-85500b9a695d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:44.346686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:44.401835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:06:44.424053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:44.427899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb0f00-5445-4277-8d9f-85500b9a695d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:44.461748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:44.462362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.462643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.462923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.474180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:06:44.483067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:44.483986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:06:44.485122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 7/14] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:06:44.490324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:44.529439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126948a-c5e0-494c-be8d-65f347940dbc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:44.531769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:44.569118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:44.570063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.570353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.570630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.574979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:44.592974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411d7a68-b974-4c71-9d64-5d4ef3d0810e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:44.626172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:44.626791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.627066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.627341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.628071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:44.628376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:44.629803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:44.638955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:44.640460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:44.644243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 8/15] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:06:44.649725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:44.741889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 8/16] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:06:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:06:44.748010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:44.750785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:44.751921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cfc8f-155c-4a2a-a20f-af22076faaf0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:44.855440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313adfc3-0e8a-47f4-8dfb-2ba974b962df None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:44.891914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:44.892806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.893091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.893376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.896293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:44.896945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:44.897226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:44.897501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] PATH_INFO: `/v3/users/e1e471e155f146cdb2493555b6df58b4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:44.898700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] RBAC: Authorizing `identity:get_user(user_id=e1e471e155f146cdb2493555b6df58b4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:44.900186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:44.902047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 9/17] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:06:44 2022] GET /identity/v3/users/e1e471e155f146cdb2493555b6df58b4 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:06:44.907315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:44.912821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:44.914649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:44.923785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:06:44.933190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:44.934241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:44.935242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:06:44.935242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:06:44.935242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:06:44.935242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:06:44.935242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 9/18] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:06:44.941514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:44.998150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:45.011842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8d871-9acd-4c02-949c-8fe763617a41 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:45.042620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5a8b0-360b-409f-8d58-75e32fe445d5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:45.044886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:45.045533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:45.045817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:45.046120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:45.047289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:45.048752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:45.050667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 10/19] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:45.056265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:45.075569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c997f-d8fb-469b-95a2-e322e7838433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:45.076194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c997f-d8fb-469b-95a2-e322e7838433 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:45.076472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c997f-d8fb-469b-95a2-e322e7838433 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:45.076742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c997f-d8fb-469b-95a2-e322e7838433 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:45.077437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c997f-d8fb-469b-95a2-e322e7838433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:45.077742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c997f-d8fb-469b-95a2-e322e7838433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:45.079175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c997f-d8fb-469b-95a2-e322e7838433 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:45.096473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 10/20] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:06:45.138722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:45.161078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a08c7b-6c75-465e-8e0c-b91641b16e53 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:45.198617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cd550-b3f1-4d4b-86d9-07092265bdc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:45.199327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd550-b3f1-4d4b-86d9-07092265bdc9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:45.199533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd550-b3f1-4d4b-86d9-07092265bdc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:45.199796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cd550-b3f1-4d4b-86d9-07092265bdc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:45.200609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd550-b3f1-4d4b-86d9-07092265bdc9 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.domain.id=default, user.id=e1e471e155f146cdb2493555b6df58b4) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:45.200921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd550-b3f1-4d4b-86d9-07092265bdc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:45.202440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cd550-b3f1-4d4b-86d9-07092265bdc9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:45.210398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 11/21] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Aug 6 01:06:45 2022] GET /identity/v3/role_assignments?user.id=e1e471e155f146cdb2493555b6df58b4&scope.domain.id=default&role.id=1aa37aeab6694470b737775bf433503d => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:06:47.372450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3396e-7225-4e95-aeee-300d6b7c8d09 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:47.372965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3396e-7225-4e95-aeee-300d6b7c8d09 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:47.372965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3396e-7225-4e95-aeee-300d6b7c8d09 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:47.374620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 11/22] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:47.387776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ffb0-1c3a-479d-a0e9-bee911361d0a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:47.388703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ffb0-1c3a-479d-a0e9-bee911361d0a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:47.389162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ffb0-1c3a-479d-a0e9-bee911361d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:47.419133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8f24ffb0-1c3a-479d-a0e9-bee911361d0a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:47.420672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8f24ffb0-1c3a-479d-a0e9-bee911361d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:47.503162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1c552-efb1-4f43-9cff-6015aa93ec99 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:47.503442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1c552-efb1-4f43-9cff-6015aa93ec99 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:47.503725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1c552-efb1-4f43-9cff-6015aa93ec99 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:47.505798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 12/23] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:47.510494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271e9d-4721-4be8-adf9-21fdd5400905 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:47.510778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271e9d-4721-4be8-adf9-21fdd5400905 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:47.511365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4271e9d-4721-4be8-adf9-21fdd5400905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:47.524436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 12/24] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:47.553967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c4271e9d-4721-4be8-adf9-21fdd5400905 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:47.555174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c4271e9d-4721-4be8-adf9-21fdd5400905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:47.561444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ffb0-1c3a-479d-a0e9-bee911361d0a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:47.674036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 13/25] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:06:47.712844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271e9d-4721-4be8-adf9-21fdd5400905 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:47.752553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:47.798301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:47.812132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ffb0-1c3a-479d-a0e9-bee911361d0a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:47.900979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4271e9d-4721-4be8-adf9-21fdd5400905 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:47.905951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:47.905951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:47.905951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:47.905951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:47.932074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:47.935055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:47.967749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd4a2-1b5e-4cf5-acde-e077a41b1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:47.968752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd4a2-1b5e-4cf5-acde-e077a41b1f65 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:47.969234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd4a2-1b5e-4cf5-acde-e077a41b1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:47.969673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd4a2-1b5e-4cf5-acde-e077a41b1f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:06:47.982365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:47.983216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:47.983993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:06:47.983993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:06:47.983993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:06:47.983993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:06:47.987400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 13/26] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:06:47.993719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:48.163631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebd4a2-1b5e-4cf5-acde-e077a41b1f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-66ebd4a2-1b5e-4cf5-acde-e077a41b1f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:06:48.171725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:48.172591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:48.173336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:06:48.179942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 14/27] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:06:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:06:48.179942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c57d-844b-4ad5-b743-956e76603755 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.179942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c57d-844b-4ad5-b743-956e76603755 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.179942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4c57d-844b-4ad5-b743-956e76603755 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.179942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 15/28] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:48.182369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408115-026c-4123-bd97-04955c39ab79 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.182874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408115-026c-4123-bd97-04955c39ab79 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.182874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51408115-026c-4123-bd97-04955c39ab79 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.184073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 16/29] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:48.186685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51408115-026c-4123-bd97-04955c39ab79 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:48.201807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c7f7b0-69c7-4c92-b5a5-3313d8adff42 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:48.231803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:48.242478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef4bca-1916-4770-8fcd-57c6d62fefb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:48.243398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4bca-1916-4770-8fcd-57c6d62fefb7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.243898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4bca-1916-4770-8fcd-57c6d62fefb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.244467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef4bca-1916-4770-8fcd-57c6d62fefb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.245468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4bca-1916-4770-8fcd-57c6d62fefb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:48.245982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4bca-1916-4770-8fcd-57c6d62fefb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:48.247732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ef4bca-1916-4770-8fcd-57c6d62fefb7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:48.266699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 14/30] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:06:48.268366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55db33-a6a0-4136-9554-562f09c925ee None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.268854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55db33-a6a0-4136-9554-562f09c925ee None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.269315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55db33-a6a0-4136-9554-562f09c925ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.288969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bd55db33-a6a0-4136-9554-562f09c925ee None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:48.290591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd55db33-a6a0-4136-9554-562f09c925ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:48.307613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51408115-026c-4123-bd97-04955c39ab79 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:48.315027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:48.344992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff75a0-f5f0-4d0a-9c90-322dbdcfc196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:48.345672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff75a0-f5f0-4d0a-9c90-322dbdcfc196 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.346143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff75a0-f5f0-4d0a-9c90-322dbdcfc196 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.346595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff75a0-f5f0-4d0a-9c90-322dbdcfc196 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.347462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff75a0-f5f0-4d0a-9c90-322dbdcfc196 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:48.347912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff75a0-f5f0-4d0a-9c90-322dbdcfc196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:48.349554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff75a0-f5f0-4d0a-9c90-322dbdcfc196 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:48.363136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 17/31] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:48.364703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f17be-42f1-4287-8afd-35cb29feb478 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.365230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f17be-42f1-4287-8afd-35cb29feb478 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.365711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f17be-42f1-4287-8afd-35cb29feb478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.368243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 15/32] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:48.369137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55db33-a6a0-4136-9554-562f09c925ee None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:48.385061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d36f17be-42f1-4287-8afd-35cb29feb478 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:48.387015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d36f17be-42f1-4287-8afd-35cb29feb478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:48.458841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 18/33] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:48.460006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f17be-42f1-4287-8afd-35cb29feb478 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:48.497833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55db33-a6a0-4136-9554-562f09c925ee None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:48.515691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:48.537155 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:48.537790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.538097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.538369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.539051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:48.540528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:48.579802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:48.584399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f17be-42f1-4287-8afd-35cb29feb478 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:48.622453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:48.623120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.623411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.623690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] PATH_INFO: `/v3/users/e1e471e155f146cdb2493555b6df58b4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.625265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] RBAC: Authorizing `identity:get_user(user_id=e1e471e155f146cdb2493555b6df58b4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:48.626769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:48.633048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 19/34] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:06:48 2022] GET /identity/v3/users/e1e471e155f146cdb2493555b6df58b4 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:48.633048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:48.681370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 16/35] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:06:48 2022] POST /identity/v3/projects => generated 301 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:48.682556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:48.772776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878238-d48e-4f97-857a-4dc3349cfefd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:48.823068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e3b59-14f3-46fd-850c-3f54ce175eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:48.823734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3b59-14f3-46fd-850c-3f54ce175eec None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.824012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3b59-14f3-46fd-850c-3f54ce175eec None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.824279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e3b59-14f3-46fd-850c-3f54ce175eec None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.825014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e3b59-14f3-46fd-850c-3f54ce175eec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:48.826860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e3b59-14f3-46fd-850c-3f54ce175eec None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:48.830027 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588f208-7e59-4115-b50d-0cad1c78f43c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:48.870177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33554ff-8a58-41b8-8762-7bcfd0c50e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:48.871191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33554ff-8a58-41b8-8762-7bcfd0c50e5e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.871794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33554ff-8a58-41b8-8762-7bcfd0c50e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.872131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33554ff-8a58-41b8-8762-7bcfd0c50e5e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.872816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33554ff-8a58-41b8-8762-7bcfd0c50e5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:48.875484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33554ff-8a58-41b8-8762-7bcfd0c50e5e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:48.895376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 17/36] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 01:06:48 2022] POST /identity/v3/roles => generated 225 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:48.896840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd083-6287-45e9-8509-b9c0433c2ebd None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.897131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd083-6287-45e9-8509-b9c0433c2ebd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.897412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd083-6287-45e9-8509-b9c0433c2ebd None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.899144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 18/37] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:48.899871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd083-6287-45e9-8509-b9c0433c2ebd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:48.937192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:48.965907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 20/38] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 01:06:48 2022] POST /identity/v3/roles => generated 219 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:48.967796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46b11a-c67e-4a1c-b88d-e8346ba8ddf5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:48.968116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46b11a-c67e-4a1c-b88d-e8346ba8ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:48.968355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46b11a-c67e-4a1c-b88d-e8346ba8ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:48.988125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ab46b11a-c67e-4a1c-b88d-e8346ba8ddf5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:48.989809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ab46b11a-c67e-4a1c-b88d-e8346ba8ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:49.012899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:49.036602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd083-6287-45e9-8509-b9c0433c2ebd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:49.077581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 21/39] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:49.086468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5545a0-fc88-4cfc-9a55-2816e2c066be None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:49.086468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5545a0-fc88-4cfc-9a55-2816e2c066be None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:49.086468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5545a0-fc88-4cfc-9a55-2816e2c066be None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:49.086468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 22/40] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:49.088569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb199-afd4-4cf0-856a-f2607dcb804f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:49.088968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb199-afd4-4cf0-856a-f2607dcb804f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:49.089352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb199-afd4-4cf0-856a-f2607dcb804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:49.106098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:49.110282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:49.110745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:49.111032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:49.112540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:49.114186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:49.117357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 19/41] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:49.118212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:49.123610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-abcfb199-afd4-4cf0-856a-f2607dcb804f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:49.124589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-abcfb199-afd4-4cf0-856a-f2607dcb804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:49.211834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 23/42] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:49.212684 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfb199-afd4-4cf0-856a-f2607dcb804f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:49.245937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:49.252535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b8dd5-86d6-4845-ab1f-bc2689c09867 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:49.290116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:49.290681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:49.290967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:49.291242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:49.291966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:49.293792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:49.305519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:49.309051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 20/43] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 01:06:49 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:49.309857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:49.325212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfb199-afd4-4cf0-856a-f2607dcb804f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:49.364847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:49.365550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:49.365845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:49.366161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] PATH_INFO: `/v3/domains/default/users/e1e471e155f146cdb2493555b6df58b4/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:49.368443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e1e471e155f146cdb2493555b6df58b4, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:49.370171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:49.388446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 24/44] 10.222.0.17 () {58 vars in 1361 bytes} [Sat Aug 6 01:06:49 2022] PUT /identity/v3/domains/default/users/e1e471e155f146cdb2493555b6df58b4/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:06:49.430670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e1a7-f2b3-47fe-ba4d-b73181c64cb1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:49.471273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4cce-94d4-4954-b10d-c3a16d5b6f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:49.471944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4cce-94d4-4954-b10d-c3a16d5b6f83 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:49.472220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4cce-94d4-4954-b10d-c3a16d5b6f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:49.472498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4cce-94d4-4954-b10d-c3a16d5b6f83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:49.473813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb4cce-94d4-4954-b10d-c3a16d5b6f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:49.475497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb4cce-94d4-4954-b10d-c3a16d5b6f83 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:49.477663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 21/45] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:49.484434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:49.604356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3273eebd-835d-4762-84e9-e9e7d86e4edb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:49.639664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4e2b4-a547-46f3-af87-b3ffdf57f8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:49.640307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4e2b4-a547-46f3-af87-b3ffdf57f8ba None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:49.640598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4e2b4-a547-46f3-af87-b3ffdf57f8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:49.640870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4e2b4-a547-46f3-af87-b3ffdf57f8ba None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:49.641560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4e2b4-a547-46f3-af87-b3ffdf57f8ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:49.643086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4e2b4-a547-46f3-af87-b3ffdf57f8ba None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:49.666750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:49.681968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 25/46] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:06:49 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:51.368543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518cc9a-160c-4397-beca-51e20d39a48f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.369104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518cc9a-160c-4397-beca-51e20d39a48f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.369104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518cc9a-160c-4397-beca-51e20d39a48f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.370542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 22/47] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:51.376006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19225d-83fc-4eb8-9cbf-5ffd9f57f622 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.376447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19225d-83fc-4eb8-9cbf-5ffd9f57f622 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.376587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19225d-83fc-4eb8-9cbf-5ffd9f57f622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.396029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6d19225d-83fc-4eb8-9cbf-5ffd9f57f622 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:51.397253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6d19225d-83fc-4eb8-9cbf-5ffd9f57f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:51.467175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 26/48] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:51.490076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518cc9a-160c-4397-beca-51e20d39a48f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:51.517400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:51.597798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518cc9a-160c-4397-beca-51e20d39a48f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:51.624177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7e01-1b1f-4763-b2f0-1d2c370db3f9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.624355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7e01-1b1f-4763-b2f0-1d2c370db3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.624623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7e01-1b1f-4763-b2f0-1d2c370db3f9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.626065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 27/49] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:06:51.630995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77812fb0-4d37-433a-840d-48ff9644bbb5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.631278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77812fb0-4d37-433a-840d-48ff9644bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.631557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77812fb0-4d37-433a-840d-48ff9644bbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.633390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:51.634091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.634376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.634655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.646563 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:06:51.649733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-77812fb0-4d37-433a-840d-48ff9644bbb5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:51.650959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-77812fb0-4d37-433a-840d-48ff9644bbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:06:51.651533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:51.652555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:06:51.653313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 23/50] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:06:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:06:51.658398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:51.723739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 28/51] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:06:51.741883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:51.746774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77812fb0-4d37-433a-840d-48ff9644bbb5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:51.758489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13c2c-623e-4e4f-871a-b8bbb25cd36e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:51.792385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:51.793018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.793297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.793582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.794348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:51.794662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:51.796084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:51.803331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:51.804860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 24/52] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:06:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:51.810665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:51.844578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77812fb0-4d37-433a-840d-48ff9644bbb5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:51.878526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:51.879103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.879386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.879661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.880965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:51.882474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:51.884084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 29/53] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:06:51.889710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:51.911093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71520677-817d-47d2-ac66-354e64af92a5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:51.943828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:51.944477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:51.944754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:51.945018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] PATH_INFO: `/v3/users/e1e471e155f146cdb2493555b6df58b4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:51.946239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] RBAC: Authorizing `identity:get_user(user_id=e1e471e155f146cdb2493555b6df58b4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:51.947761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:51.949368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 25/54] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:06:51 2022] GET /identity/v3/users/e1e471e155f146cdb2493555b6df58b4 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:51.954983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:51.970518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:51.994916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc997f2-5bbd-4861-8398-6bab6a21bc0c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:52.020166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:52.029475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:52.030145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:52.030431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:52.030708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:52.031421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:52.032900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:52.055011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ec72a-aacc-4614-bce8-9ce043846b8a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:52.062404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 30/55] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Aug 6 01:06:51 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:52.089277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3541fe-7556-4360-9f00-fd8eee5ec97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:52.090002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3541fe-7556-4360-9f00-fd8eee5ec97c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:52.090289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3541fe-7556-4360-9f00-fd8eee5ec97c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:52.090564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3541fe-7556-4360-9f00-fd8eee5ec97c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:52.091830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3541fe-7556-4360-9f00-fd8eee5ec97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:52.093364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3541fe-7556-4360-9f00-fd8eee5ec97c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:52.095078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 26/56] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:06:52.101600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:52.220763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f4ed5-bf4c-4ff4-861c-626e95c664e9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:52.256539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7162a9-77b5-4e06-baf9-4108a56050db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:52.257188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7162a9-77b5-4e06-baf9-4108a56050db None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:52.257453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7162a9-77b5-4e06-baf9-4108a56050db None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:52.257724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7162a9-77b5-4e06-baf9-4108a56050db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:52.258624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7162a9-77b5-4e06-baf9-4108a56050db None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.domain.id=default, user.id=e1e471e155f146cdb2493555b6df58b4) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:52.258933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7162a9-77b5-4e06-baf9-4108a56050db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:52.260419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7162a9-77b5-4e06-baf9-4108a56050db None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:52.268617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 31/57] 10.222.0.17 () {56 vars in 1322 bytes} [Sat Aug 6 01:06:52 2022] GET /identity/v3/role_assignments?user.id=e1e471e155f146cdb2493555b6df58b4&scope.domain.id=default&role.id=1aa37aeab6694470b737775bf433503d => generated 530 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:54.063565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db78611-948b-4e3d-9650-45e825062a3d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:54.064131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db78611-948b-4e3d-9650-45e825062a3d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:54.064131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db78611-948b-4e3d-9650-45e825062a3d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:54.066347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 27/58] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:54.072233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e5815-9f65-4a9d-a95b-ab3012e57c3b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:54.072604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e5815-9f65-4a9d-a95b-ab3012e57c3b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:54.072815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e5815-9f65-4a9d-a95b-ab3012e57c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:54.092583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8c2e5815-9f65-4a9d-a95b-ab3012e57c3b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:54.093789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8c2e5815-9f65-4a9d-a95b-ab3012e57c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:54.132629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:54.167192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 32/59] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:54.191463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db78611-948b-4e3d-9650-45e825062a3d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:54.286937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:54.306699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db78611-948b-4e3d-9650-45e825062a3d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:54.340556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7016c-449b-419e-a9f9-7bcc70044698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:54.341141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7016c-449b-419e-a9f9-7bcc70044698 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:54.341424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7016c-449b-419e-a9f9-7bcc70044698 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:54.341707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7016c-449b-419e-a9f9-7bcc70044698 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:54.342927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7016c-449b-419e-a9f9-7bcc70044698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:54.344415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7016c-449b-419e-a9f9-7bcc70044698 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:54.346038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 28/60] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:54.352132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e5815-9f65-4a9d-a95b-ab3012e57c3b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:54.451155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e5815-9f65-4a9d-a95b-ab3012e57c3b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:54.485764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35c328-baac-41e9-aa07-b4430e10fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:54.486407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c328-baac-41e9-aa07-b4430e10fda0 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:54.486687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c328-baac-41e9-aa07-b4430e10fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:54.486955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35c328-baac-41e9-aa07-b4430e10fda0 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:54.487635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35c328-baac-41e9-aa07-b4430e10fda0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:54.489170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35c328-baac-41e9-aa07-b4430e10fda0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:54.521137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 33/61] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:06:54 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:57.697415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdcc80-bc8c-488f-bafa-1617c35a42cc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.698474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdcc80-bc8c-488f-bafa-1617c35a42cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.698952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdcc80-bc8c-488f-bafa-1617c35a42cc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.700518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 29/62] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:57.705919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb04e5-aaf4-4c39-9ca5-7be9469bfc69 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.706738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb04e5-aaf4-4c39-9ca5-7be9469bfc69 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.707205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb04e5-aaf4-4c39-9ca5-7be9469bfc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.734194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-07bb04e5-aaf4-4c39-9ca5-7be9469bfc69 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:57.735796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-07bb04e5-aaf4-4c39-9ca5-7be9469bfc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:57.738501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc879d-0536-45e5-a189-371ba08306ba None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.738997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc879d-0536-45e5-a189-371ba08306ba None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.739457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc879d-0536-45e5-a189-371ba08306ba None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.741115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 30/63] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:06:57.747371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab6a5-9123-466e-b8a3-2c9266719376 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.747646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab6a5-9123-466e-b8a3-2c9266719376 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.747931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ab6a5-9123-466e-b8a3-2c9266719376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.782263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4b1ab6a5-9123-466e-b8a3-2c9266719376 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:57.783714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4b1ab6a5-9123-466e-b8a3-2c9266719376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:57.792825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:57.861643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 34/64] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:06:57.870362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 31/65] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:57.870362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d329-0c5e-42be-b512-04ef46f1bd6b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.870362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d329-0c5e-42be-b512-04ef46f1bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.870362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7d329-0c5e-42be-b512-04ef46f1bd6b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.870362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 32/66] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:57.870362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b3f5-2def-4431-bcb9-4f7a101b6ddb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.870362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b3f5-2def-4431-bcb9-4f7a101b6ddb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.870781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93b3f5-2def-4431-bcb9-4f7a101b6ddb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.870781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 33/67] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:57.872923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1158-5505-4c7e-9e28-36869f0e8ab2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.873210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1158-5505-4c7e-9e28-36869f0e8ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.873492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1158-5505-4c7e-9e28-36869f0e8ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.881139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911e078-4cab-4ec3-a4bb-dd85da097713 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:57.881497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911e078-4cab-4ec3-a4bb-dd85da097713 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:57.881756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911e078-4cab-4ec3-a4bb-dd85da097713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:57.897764 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d80f1158-5505-4c7e-9e28-36869f0e8ab2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:57.898992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d80f1158-5505-4c7e-9e28-36869f0e8ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:57.904894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6911e078-4cab-4ec3-a4bb-dd85da097713 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:57.906097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6911e078-4cab-4ec3-a4bb-dd85da097713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:57.973988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 34/68] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:57.975214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1158-5505-4c7e-9e28-36869f0e8ab2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:57.979800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 35/69] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:06:57.980817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911e078-4cab-4ec3-a4bb-dd85da097713 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:57.997244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.080379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.093155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911e078-4cab-4ec3-a4bb-dd85da097713 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.095567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1158-5505-4c7e-9e28-36869f0e8ab2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.129474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.130203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.130482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.130755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.133061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.133987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.134463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.134912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.141131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:06:58.146113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:58.147049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:06:58.147804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:06:58.148392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:06:58.148457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 36/70] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:06:58.148457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:06:58.151283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:58.152279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:06:58.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:06:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:06:58.153632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.233299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.268823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8269ea8-c4ee-4380-87dc-bb05e9def292 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.269064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99422c-4311-45e4-a3ea-1ac7518c2439 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.303541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.303732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.304189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.304288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.304471 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.304559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.304738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.304833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.315571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:06:58.316671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:06:58.320594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:58.321448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:06:58.322227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:06:58.322812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:06:58.323571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:06:58.325157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:06:58.327587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 36/72] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:06:58.327587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.327863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:06:58.327863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.338929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.424578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106a890-f8ad-465f-8cdc-c8a251b1259b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.426314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ff2f-f47e-4091-9ade-0df5210ad08e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.453263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.460497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f24bf-6859-49c6-a8bd-d706e9d512c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.461121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f24bf-6859-49c6-a8bd-d706e9d512c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.461403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f24bf-6859-49c6-a8bd-d706e9d512c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.461677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f24bf-6859-49c6-a8bd-d706e9d512c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.462432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f24bf-6859-49c6-a8bd-d706e9d512c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:58.462544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.462740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f24bf-6859-49c6-a8bd-d706e9d512c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:58.463058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.463341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.463620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.464146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f24bf-6859-49c6-a8bd-d706e9d512c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:58.464340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:58.464652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:58.466082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:58.472648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 37/74] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:58.473648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9fd90-3d98-4cd8-b145-e76aa8e68c77 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.473951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9fd90-3d98-4cd8-b145-e76aa8e68c77 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.474245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9fd90-3d98-4cd8-b145-e76aa8e68c77 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.475509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 38/75] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:06:58.478040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9fd90-3d98-4cd8-b145-e76aa8e68c77 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.481641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 38/76] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:58.482441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.558332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.577382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9fd90-3d98-4cd8-b145-e76aa8e68c77 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.588731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd241d-6ff5-4a06-9eba-b241ca882cdf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.611370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.611907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.612197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.612475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.613205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:58.613517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:58.614964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:58.621036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6e920-492f-4fe7-9419-48af164b68fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.621677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e920-492f-4fe7-9419-48af164b68fd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.621985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e920-492f-4fe7-9419-48af164b68fd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.622280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e920-492f-4fe7-9419-48af164b68fd None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.622931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 39/77] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:58.627793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6e920-492f-4fe7-9419-48af164b68fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:06:58.627793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6e920-492f-4fe7-9419-48af164b68fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:58.627922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.628018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6e920-492f-4fe7-9419-48af164b68fd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:58.633865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 39/78] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:58.635091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3e939-3a0a-4fd5-9703-dae5252f254f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.635399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3e939-3a0a-4fd5-9703-dae5252f254f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.635652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3e939-3a0a-4fd5-9703-dae5252f254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.653641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e5a3e939-3a0a-4fd5-9703-dae5252f254f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:06:58.654937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e5a3e939-3a0a-4fd5-9703-dae5252f254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:06:58.677166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.721277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ab09f-7fc1-4c8e-bbdb-3c8d56af2811 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.723464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 40/79] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:06:58.724302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3e939-3a0a-4fd5-9703-dae5252f254f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.754866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.755506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.755787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.756092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] PATH_INFO: `/v3/users/e1e471e155f146cdb2493555b6df58b4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.757354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] RBAC: Authorizing `identity:get_user(user_id=e1e471e155f146cdb2493555b6df58b4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:58.758870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:58.760507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 40/80] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/users/e1e471e155f146cdb2493555b6df58b4 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:58.761232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.796368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.834616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3e939-3a0a-4fd5-9703-dae5252f254f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.858168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b4206-49c5-489f-8b00-d9f03a713728 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.868285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.868885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.869168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.869448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.879808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:58.884057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:58.885569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:58.887576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 41/81] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:58.888166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.890993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:58.891639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:58.891917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:58.892327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:58.893517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:58.895042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:58.896899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 41/82] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:58.897518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:58.992180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da0e3b-031c-48e1-aaba-62654dea2472 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:58.992391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25029f-1bb4-488e-8a4a-37e9297b623d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:59.012375 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.026321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.026863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.026970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.027220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.027493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.027578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.027786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.028067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.028650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.029258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.030139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.030751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.031743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 42/83] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:59.037260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 42/84] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:06:58 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:59.037422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:59.037512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:59.095680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.137395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73050fe6-6dab-4057-a132-6b5df9d0c1bf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:59.137586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea126a2-ce69-44c2-b0a3-5dbc5fd796e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:59.170351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.170980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.171264 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.171548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.172613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.173235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.173523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.173796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.226455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.240863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.242379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.242486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.243883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.300475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.342931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 43/85] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:06:59.343780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:59.349078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 43/86] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:06:59.351002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:59.440157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.444848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705c946-4863-42f8-802a-a760d1c52266 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:59.452356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babbb9e3-178c-4f4f-8c02-02a325dcb368 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:59.479214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.479844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.480126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.480397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.485821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.486472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.486750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.487019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.487706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.489164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.512125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 44/87] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:06:59 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:06:59.512318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.512987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:59.567645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.569258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.628136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a5e4-3fe4-4be3-a547-d471324c1de3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:59.667085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.667747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.668028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.668307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.687536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 44/88] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:06:59.689370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:59.697746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.782518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:06:59.795046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.796559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.832569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238d23-83ea-4838-80df-aa4f13413258 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:06:59.875283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:06:59.876056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:06:59.876424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:06:59.876765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:06:59.878051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:06:59.879609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:06:59.881738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 45/89] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:06:59 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:06:59.882688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:06:59.941984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 45/90] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:06:59.942853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:00.008631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:00.041959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb8c6-56ea-4a01-aada-65b15d9fc48b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:00.073962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d290d07-b5fc-49fb-beb3-2e781a65c697 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:00.109959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:00.121962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:00.122138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:00.125959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:00.125959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:00.125959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:00.126205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:00.126205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:00.126338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:00.126401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:00.126401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:00.129951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:00.132661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:00.132661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 46/92] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:06:59 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:00.137990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 46/92] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:06:59 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:00.137990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:00.139120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:00.264779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e5bf60-4670-4033-b464-c6ecf2c8e5cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:00.278071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015c7b4d-67d4-4e25-99dc-d3b7483073b5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:00.294550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:00.308258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:00.309200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:00.309613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:00.310131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] PATH_INFO: `/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:00.311567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] RBAC: Authorizing `identity:get_project(project_id=585da9c974aa49dbb49f28bce5e7f6b1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:00.313433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:00.313895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:00.314652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:00.315143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 47/93] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:00 2022] GET /identity/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:00.315426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:00.316217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:00.317171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=e1e471e155f146cdb2493555b6df58b4) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:00.317591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:00.319279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:00.320787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:00.325804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 47/94] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:00 2022] GET /identity/v3/role_assignments?user.id=e1e471e155f146cdb2493555b6df58b4&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:00.326800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:00.448038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:00.511487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497baf5-d16f-4d5a-bfee-1f2464ede595 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:00.529510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08cbd02-6db6-46b3-b71e-108c3dc50ac2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:00.570297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:00.570933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:00.571218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:00.571498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:00.572305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=8fd98010f65d42aeb277ffa7a796efbf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:00.572623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:00.574134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:00.588747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 48/95] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:00 2022] GET /identity/v3/role_assignments?user.id=8fd98010f65d42aeb277ffa7a796efbf&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=96d2ad5552c34a6799019f0c9786745b => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:00.589379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:00.597010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b5dd0-9d59-4d91-a7fa-ca2a6673c191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:00.597676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5dd0-9d59-4d91-a7fa-ca2a6673c191 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:00.597973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5dd0-9d59-4d91-a7fa-ca2a6673c191 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:00.598251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b5dd0-9d59-4d91-a7fa-ca2a6673c191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:00.599070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b5dd0-9d59-4d91-a7fa-ca2a6673c191 None admin] RBAC: Adding query filter params (role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=8fd98010f65d42aeb277ffa7a796efbf) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:00.599381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b5dd0-9d59-4d91-a7fa-ca2a6673c191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:00.602255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b5dd0-9d59-4d91-a7fa-ca2a6673c191 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:00.613659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 48/96] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:00 2022] GET /identity/v3/role_assignments?user.id=8fd98010f65d42aeb277ffa7a796efbf&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:00.749426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5910782-ef73-4933-aaa9-1ac287d7b0c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:00.788820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:00.804385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceadf61-4efe-4439-8b66-64aa70a25178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:00.805874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceadf61-4efe-4439-8b66-64aa70a25178 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:00.805874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceadf61-4efe-4439-8b66-64aa70a25178 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:00.805874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceadf61-4efe-4439-8b66-64aa70a25178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:00.806425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceadf61-4efe-4439-8b66-64aa70a25178 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=585da9c974aa49dbb49f28bce5e7f6b1, user.id=8fd98010f65d42aeb277ffa7a796efbf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:00.806743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceadf61-4efe-4439-8b66-64aa70a25178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:00.808266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceadf61-4efe-4439-8b66-64aa70a25178 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:00.816720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 49/97] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:00 2022] GET /identity/v3/role_assignments?user.id=8fd98010f65d42aeb277ffa7a796efbf&scope.project.id=585da9c974aa49dbb49f28bce5e7f6b1&role.id=96d2ad5552c34a6799019f0c9786745b => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:02.069378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9db3a-2589-4129-9cc4-615b1b5fcb41 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.070698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9db3a-2589-4129-9cc4-615b1b5fcb41 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.071187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9db3a-2589-4129-9cc4-615b1b5fcb41 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.072802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 49/98] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:02.079428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9133b2-4173-43aa-9751-1ed2be677aad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.080502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9133b2-4173-43aa-9751-1ed2be677aad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.081300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9133b2-4173-43aa-9751-1ed2be677aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.092178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19753c6-9e51-47dc-a798-7baf7a2a4ebc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.092771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19753c6-9e51-47dc-a798-7baf7a2a4ebc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.093246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19753c6-9e51-47dc-a798-7baf7a2a4ebc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.094886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 50/99] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:02.104164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bf735-2175-41e8-bc0e-e0d59ad3fe62 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.104697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bf735-2175-41e8-bc0e-e0d59ad3fe62 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.105171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bf735-2175-41e8-bc0e-e0d59ad3fe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.115220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9d9133b2-4173-43aa-9751-1ed2be677aad None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:02.121662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d9133b2-4173-43aa-9751-1ed2be677aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:02.137133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ba5bf735-2175-41e8-bc0e-e0d59ad3fe62 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:02.138661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ba5bf735-2175-41e8-bc0e-e0d59ad3fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:02.220275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:02.255630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 50/100] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:02.295465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 51/101] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:02.296011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9133b2-4173-43aa-9751-1ed2be677aad None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:02.338933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bf735-2175-41e8-bc0e-e0d59ad3fe62 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:02.531778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bf735-2175-41e8-bc0e-e0d59ad3fe62 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:02.538135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9133b2-4173-43aa-9751-1ed2be677aad None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:02.590384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:02.607602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:02.608302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.608580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.608853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.610041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:02.611501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:02.613119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 52/102] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:02.619257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:02.647368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:02.648093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.648380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.648651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.670706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:02.686566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:02.691621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:02.692545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:02.693797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 51/103] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:02.701029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:02.738020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5347027-7a15-4048-9d12-84d7331fc142 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:02.780123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:02.780766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.781047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.781320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.782043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:02.783501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:02.827944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 53/104] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:07:02 2022] POST /identity/v3/projects => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:02.870078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e5508-7bf8-4cf8-87d4-69f24ecf07cb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:02.921181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45a757b-e58e-4d4f-952a-29315061e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:02.921887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a757b-e58e-4d4f-952a-29315061e056 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.922194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a757b-e58e-4d4f-952a-29315061e056 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.922468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a757b-e58e-4d4f-952a-29315061e056 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.923217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a757b-e58e-4d4f-952a-29315061e056 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:02.923527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a757b-e58e-4d4f-952a-29315061e056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:02.924986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45a757b-e58e-4d4f-952a-29315061e056 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:02.938169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 52/105] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:02.944408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:02.950899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280de871-5a31-4342-a922-fb420d8893d4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.951206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280de871-5a31-4342-a922-fb420d8893d4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.951458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280de871-5a31-4342-a922-fb420d8893d4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.952847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 53/106] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:02.958527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45734-f603-46f8-8917-0e0bc11c540e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:02.959190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45734-f603-46f8-8917-0e0bc11c540e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:02.959655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd45734-f603-46f8-8917-0e0bc11c540e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:02.987611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7cd45734-f603-46f8-8917-0e0bc11c540e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:02.989200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7cd45734-f603-46f8-8917-0e0bc11c540e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:03.069983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:03.124866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 54/107] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:03.153081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:03.160433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd45734-f603-46f8-8917-0e0bc11c540e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:03.176369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70e47-008b-46e6-a5ac-961026886649 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:03.242662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:03.243839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.245146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.246393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] PATH_INFO: `/v3/users/90bb4113f250439488788939e6204036` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.270830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] RBAC: Authorizing `identity:get_user(user_id=90bb4113f250439488788939e6204036)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:03.273453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:03.276104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 54/108] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:02 2022] GET /identity/v3/users/90bb4113f250439488788939e6204036 => generated 289 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:03.283011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:03.360082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd45734-f603-46f8-8917-0e0bc11c540e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:03.427343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb00103-faa5-47df-8d8e-c504df7aaeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:03.427343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00103-faa5-47df-8d8e-c504df7aaeca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.427343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00103-faa5-47df-8d8e-c504df7aaeca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.427343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb00103-faa5-47df-8d8e-c504df7aaeca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.440429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb00103-faa5-47df-8d8e-c504df7aaeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-beb00103-faa5-47df-8d8e-c504df7aaeca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:03.445818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:03.446685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:03.447423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 55/109] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:03.448561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b7a8-487d-45aa-a481-888d26759b3a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.448561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b7a8-487d-45aa-a481-888d26759b3a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.448791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561b7a8-487d-45aa-a481-888d26759b3a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.454249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 56/110] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:03.454752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561b7a8-487d-45aa-a481-888d26759b3a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:03.470453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab9e9d-60f0-4f6d-9166-bc3c66a6540f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:03.530324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:03.540467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:03.541360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.541855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.542160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.578418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:03.651612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561b7a8-487d-45aa-a481-888d26759b3a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:03.665951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:03.665951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:03.707661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7ee3-5c22-4ecd-a1d0-c748d39c1486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:03.708633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7ee3-5c22-4ecd-a1d0-c748d39c1486 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.709176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7ee3-5c22-4ecd-a1d0-c748d39c1486 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.709647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7ee3-5c22-4ecd-a1d0-c748d39c1486 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.710674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f7ee3-5c22-4ecd-a1d0-c748d39c1486 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:03.711171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f7ee3-5c22-4ecd-a1d0-c748d39c1486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:03.712793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f7ee3-5c22-4ecd-a1d0-c748d39c1486 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:03.728945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 57/111] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:03.730517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5cd4-bfc1-40f8-9fb3-f7d5d9252bc5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.737952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5cd4-bfc1-40f8-9fb3-f7d5d9252bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.738625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e5cd4-bfc1-40f8-9fb3-f7d5d9252bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.764626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 55/112] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:03.770009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:03.774957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c33e5cd4-bfc1-40f8-9fb3-f7d5d9252bc5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:03.776434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c33e5cd4-bfc1-40f8-9fb3-f7d5d9252bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:03.824870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:03.868395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 58/113] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:03.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e5cd4-bfc1-40f8-9fb3-f7d5d9252bc5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:03.894355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:03.894728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5859b-8a7c-4ce1-aca7-2a3597934d9b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:03.933721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f2abc-9622-49cd-ba16-2ad357789d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:03.934624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f2abc-9622-49cd-ba16-2ad357789d45 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.935006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f2abc-9622-49cd-ba16-2ad357789d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.935379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f2abc-9622-49cd-ba16-2ad357789d45 None admin] PATH_INFO: `/v3/users/e1e471e155f146cdb2493555b6df58b4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.936745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f2abc-9622-49cd-ba16-2ad357789d45 None admin] RBAC: Authorizing `identity:get_user(user_id=e1e471e155f146cdb2493555b6df58b4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:03.938464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f2abc-9622-49cd-ba16-2ad357789d45 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:03.940390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 56/114] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:03 2022] GET /identity/v3/users/e1e471e155f146cdb2493555b6df58b4 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:03.941607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763e9d4-50a8-4d6a-9b06-48da661d3b80 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:03.942043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763e9d4-50a8-4d6a-9b06-48da661d3b80 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:03.942499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763e9d4-50a8-4d6a-9b06-48da661d3b80 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:03.944262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 57/115] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:03.945056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763e9d4-50a8-4d6a-9b06-48da661d3b80 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:03.989466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e5cd4-bfc1-40f8-9fb3-f7d5d9252bc5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.023537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.024187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.024472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.024748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.025964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:04.027447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:04.029139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 59/116] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:03 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:04.029902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.060614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763e9d4-50a8-4d6a-9b06-48da661d3b80 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.078283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:04.097992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee52ca-fbd1-498e-9abb-2047f7692cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.098660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee52ca-fbd1-498e-9abb-2047f7692cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.098937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee52ca-fbd1-498e-9abb-2047f7692cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.099212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee52ca-fbd1-498e-9abb-2047f7692cd5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.109851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee52ca-fbd1-498e-9abb-2047f7692cd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c0ee52ca-fbd1-498e-9abb-2047f7692cd5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:04.114767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:04.115831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:04.116793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 58/117] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:04.117603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03223a4-668e-42cc-882f-abd74c857a02 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.117881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03223a4-668e-42cc-882f-abd74c857a02 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.118181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03223a4-668e-42cc-882f-abd74c857a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.135355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d03223a4-668e-42cc-882f-abd74c857a02 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:04.136541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d03223a4-668e-42cc-882f-abd74c857a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:04.155584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:04.165956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7382d-1d77-4c22-abba-47ed98f63e77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.201593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb5d55-e7d8-40b6-9c09-c26e47500954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.202270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5d55-e7d8-40b6-9c09-c26e47500954 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.202595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5d55-e7d8-40b6-9c09-c26e47500954 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.202862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb5d55-e7d8-40b6-9c09-c26e47500954 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.203966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb5d55-e7d8-40b6-9c09-c26e47500954 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:04.205444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb5d55-e7d8-40b6-9c09-c26e47500954 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:04.211932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 60/118] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:04.211932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565accdc-d06b-455b-8ed1-80c8bbe6e63c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.211932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565accdc-d06b-455b-8ed1-80c8bbe6e63c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.211932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565accdc-d06b-455b-8ed1-80c8bbe6e63c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.211932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 61/119] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:04.211932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565accdc-d06b-455b-8ed1-80c8bbe6e63c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.216845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 59/120] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:04.221290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03223a4-668e-42cc-882f-abd74c857a02 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.315735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565accdc-d06b-455b-8ed1-80c8bbe6e63c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.329396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03223a4-668e-42cc-882f-abd74c857a02 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.337374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:04.351814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.352520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.352870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.353214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.354135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] RBAC: Adding query filter params (role.id=c504cf6f193e4ddba25a02f8a6ab6883, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=90bb4113f250439488788939e6204036) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:04.354511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:04.356057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:04.367317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 62/121] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/role_assignments?user.id=90bb4113f250439488788939e6204036&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=c504cf6f193e4ddba25a02f8a6ab6883 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:04.367317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.373626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f597c-1eef-457f-b6d6-b7b75807fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.374326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f597c-1eef-457f-b6d6-b7b75807fbbd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.374617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f597c-1eef-457f-b6d6-b7b75807fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.374885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f597c-1eef-457f-b6d6-b7b75807fbbd None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.375639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f597c-1eef-457f-b6d6-b7b75807fbbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:04.375951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f597c-1eef-457f-b6d6-b7b75807fbbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:04.377414 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f597c-1eef-457f-b6d6-b7b75807fbbd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:04.396997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 60/122] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:04.399476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867f83-0369-45ee-8bfb-29df87fcf51a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.399975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867f83-0369-45ee-8bfb-29df87fcf51a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.400728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50867f83-0369-45ee-8bfb-29df87fcf51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.403148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:04.429403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-50867f83-0369-45ee-8bfb-29df87fcf51a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:04.431166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-50867f83-0369-45ee-8bfb-29df87fcf51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:04.499324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb3f0e-3de2-441f-b80b-8bf5693c7227 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.540857 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 61/123] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:04.544145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50867f83-0369-45ee-8bfb-29df87fcf51a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.558575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.559812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.560513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.560969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411/users/e1e471e155f146cdb2493555b6df58b4/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.563567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=09a78bed4fac444bba365f738da8e411, user_id=e1e471e155f146cdb2493555b6df58b4, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:04.566331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:04.587486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 63/124] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:04 2022] PUT /identity/v3/projects/09a78bed4fac444bba365f738da8e411/users/e1e471e155f146cdb2493555b6df58b4/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:04.589317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.706331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:04.711798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:04.720225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380f19c-0a9a-42df-ae99-e129a27964d6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.724788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50867f83-0369-45ee-8bfb-29df87fcf51a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.765018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.766148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.766633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.767581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.769104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:04.771473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:04.775816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 64/125] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:04.776993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.795401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.796114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.796394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.796773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.814175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:04.821640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:04.822527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:04.823284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:04.826369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 62/126] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:04.827329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:04.899241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aadcf-de78-47a4-a29c-3d2faa112ee9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.949023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:04.950565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:04.950852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:04.951132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:04.966119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c0837-2715-4bb3-ab7f-78652568deb7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:04.971572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:04.984665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:04.985570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 65/127] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:04.986361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:05.003147 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:05.004041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.004168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.004458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.005717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:05.007393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:05.009181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 63/128] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:05.013763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:05.016042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:05.046521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:05.126266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c8a9-73a9-410c-8de0-2466afaa3814 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:05.163693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:05.164343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.164638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.165162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.166093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:05.166637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:05.168220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:05.179073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 64/129] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:05.180606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:05.280375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b1dff-c704-46d7-bbf3-66c9ca62b4b6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:05.314324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:05.339532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:05.340053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299c699-2946-416a-af9e-91085c88c46d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:05.340183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.340450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.340732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.341676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:05.342019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:05.343443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:05.353803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 66/130] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:05.354677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:05.411747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:05.412632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.412928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.413469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411/users/8fd98010f65d42aeb277ffa7a796efbf/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.418494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] RBAC: Authorizing `identity:create_grant(project_id=09a78bed4fac444bba365f738da8e411, user_id=8fd98010f65d42aeb277ffa7a796efbf, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:05.420472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:05.450175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 65/131] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:05 2022] PUT /identity/v3/projects/09a78bed4fac444bba365f738da8e411/users/8fd98010f65d42aeb277ffa7a796efbf/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:05.451042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:05.460816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:05.527170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9eb0a-611b-4118-8dd2-e4b1f60e3cec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:05.602573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60e6cf-6704-4867-92fb-387bd3daf88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:05.603302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60e6cf-6704-4867-92fb-387bd3daf88f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.603591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60e6cf-6704-4867-92fb-387bd3daf88f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.604028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60e6cf-6704-4867-92fb-387bd3daf88f None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.606250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60e6cf-6704-4867-92fb-387bd3daf88f None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:05.607857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60e6cf-6704-4867-92fb-387bd3daf88f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:05.609572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 67/132] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:05 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:05.610806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae678edc-7672-4084-9a2a-4334f364faad None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.611092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae678edc-7672-4084-9a2a-4334f364faad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.611987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae678edc-7672-4084-9a2a-4334f364faad None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.613473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 68/133] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:05.620065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b048b83-697e-4a84-889b-30bf185e09f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.620356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b048b83-697e-4a84-889b-30bf185e09f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.620639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b048b83-697e-4a84-889b-30bf185e09f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.669403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecaf17e-b5ec-4368-aa55-24c0e4d97c6e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:05.671128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0b048b83-697e-4a84-889b-30bf185e09f0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:05.672429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b048b83-697e-4a84-889b-30bf185e09f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:05.736392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:05.737122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.737401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.737678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.739025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:05.740578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:05.742559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 66/134] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:05 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:05.743230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:05.764945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:05.776463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 69/135] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:05.777861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b048b83-697e-4a84-889b-30bf185e09f0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:05.865757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:05.895114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088c052-19b0-4c16-9b2a-202cd4b71dcf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:05.898402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b048b83-697e-4a84-889b-30bf185e09f0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:05.936447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:05.937122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:05.937407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:05.937684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:05.938933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:05.940580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:05.942491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 70/136] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:05 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:05.943279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:06.022539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:06.023236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:06.023520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:06.023794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] PATH_INFO: `/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:06.025051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] RBAC: Authorizing `identity:get_project(project_id=585da9c974aa49dbb49f28bce5e7f6b1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:06.026581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:06.034418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 67/137] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:05 2022] GET /identity/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1 => generated 312 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:06.035701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:06.053328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88a038-5891-4741-8bfa-e3e9132e04e1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:06.091519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:06.092275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:06.092568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:06.092846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:06.094089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:06.095568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:06.097863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 71/138] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:06.101577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:06.111653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:06.208988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd773a-20cd-4e7e-b23b-3b8f114b908d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:06.246629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:06.247638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:06.248097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:06.248548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] PATH_INFO: `/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1/users/8fd98010f65d42aeb277ffa7a796efbf/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:06.250984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] RBAC: Authorizing `identity:create_grant(project_id=585da9c974aa49dbb49f28bce5e7f6b1, user_id=8fd98010f65d42aeb277ffa7a796efbf, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:06.252638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:06.263878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:06.272056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 72/139] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:06 2022] PUT /identity/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1/users/8fd98010f65d42aeb277ffa7a796efbf/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:06.274215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:06.309238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6931677-c11c-4a5e-8de9-33921816b8f1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:06.367261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93d6bc-e08f-4733-ae49-49c70f3e9c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:06.369626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d6bc-e08f-4733-ae49-49c70f3e9c02 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:06.370322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d6bc-e08f-4733-ae49-49c70f3e9c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:06.370828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93d6bc-e08f-4733-ae49-49c70f3e9c02 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411/users/8fd98010f65d42aeb277ffa7a796efbf/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:06.373684 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d6bc-e08f-4733-ae49-49c70f3e9c02 None admin] RBAC: Authorizing `identity:create_grant(project_id=09a78bed4fac444bba365f738da8e411, user_id=8fd98010f65d42aeb277ffa7a796efbf, role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:06.375979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93d6bc-e08f-4733-ae49-49c70f3e9c02 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:06.404096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 68/140] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:06 2022] PUT /identity/v3/projects/09a78bed4fac444bba365f738da8e411/users/8fd98010f65d42aeb277ffa7a796efbf/roles/063bbdfce3224ede93cacead71ab0bfa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:06.420319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:06.476470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b5a44a-fcb1-4ebb-ae1a-85f982d0f8bd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:06.540908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd2052-31b4-432c-aa0d-cd33849ac756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:06.541575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2052-31b4-432c-aa0d-cd33849ac756 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:06.541853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2052-31b4-432c-aa0d-cd33849ac756 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:06.542165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2052-31b4-432c-aa0d-cd33849ac756 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:06.542875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd2052-31b4-432c-aa0d-cd33849ac756 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:06.544413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd2052-31b4-432c-aa0d-cd33849ac756 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:06.590494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 73/141] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:06 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:06.696360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4366-30cb-40bc-8755-fd004bc69748 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:06.696689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4366-30cb-40bc-8755-fd004bc69748 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:06.696919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2a4366-30cb-40bc-8755-fd004bc69748 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:06.698359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 69/142] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:06.704375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9aad-a7cc-41c1-bdde-739113c1fe39 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:06.704982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9aad-a7cc-41c1-bdde-739113c1fe39 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:06.705442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a9aad-a7cc-41c1-bdde-739113c1fe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:06.729510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-da9a9aad-a7cc-41c1-bdde-739113c1fe39 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:06.731077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da9a9aad-a7cc-41c1-bdde-739113c1fe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:06.809008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 74/143] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:06.831873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a4366-30cb-40bc-8755-fd004bc69748 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:06.961591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2a4366-30cb-40bc-8755-fd004bc69748 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:07.008974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:07.009997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.010468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.010925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.021679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:07.027015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:07.027860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:07.028623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:07.030986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 70/144] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:07.037501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9aad-a7cc-41c1-bdde-739113c1fe39 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:07.107046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:07.156183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a9aad-a7cc-41c1-bdde-739113c1fe39 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:07.198679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d889d-f4c9-40cf-8501-c1b5334cec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:07.199663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d889d-f4c9-40cf-8501-c1b5334cec8f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.200127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d889d-f4c9-40cf-8501-c1b5334cec8f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.200585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d889d-f4c9-40cf-8501-c1b5334cec8f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.201599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d889d-f4c9-40cf-8501-c1b5334cec8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:07.202121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d889d-f4c9-40cf-8501-c1b5334cec8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:07.203754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d889d-f4c9-40cf-8501-c1b5334cec8f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:07.217544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 75/145] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:07.223501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:07.231750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:07.375079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb60217-acc8-4501-80fb-e7206db71b8a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:07.379173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fa65-1c41-4fa3-93c3-27e4867120db None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.379682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fa65-1c41-4fa3-93c3-27e4867120db None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.380142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7fa65-1c41-4fa3-93c3-27e4867120db None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.386257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 76/146] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:07.392581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db892f-753f-4249-8bd7-08ad16419340 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.392861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db892f-753f-4249-8bd7-08ad16419340 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.393136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db892f-753f-4249-8bd7-08ad16419340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.418951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:07.419618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.419900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.420175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] PATH_INFO: `/v3/users/90bb4113f250439488788939e6204036` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.421554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] RBAC: Authorizing `identity:get_user(user_id=90bb4113f250439488788939e6204036)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:07.423218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:07.425233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 71/147] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:07 2022] GET /identity/v3/users/90bb4113f250439488788939e6204036 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:07.433254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:07.433403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-85db892f-753f-4249-8bd7-08ad16419340 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:07.434515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-85db892f-753f-4249-8bd7-08ad16419340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:07.529279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:07.567992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49c020-975e-418f-b046-fcf76f1b2f55 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:07.575853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 77/148] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:07.605439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:07.606143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.606434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.606714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.607923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:07.609401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:07.611281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 72/149] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:07 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:07.619026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:07.619265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db892f-753f-4249-8bd7-08ad16419340 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:07.725836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:07.739118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f63638-a5af-497b-b253-0c881f470de8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:07.783367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:07.784333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.785115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.785552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411/users/90bb4113f250439488788939e6204036/roles/c504cf6f193e4ddba25a02f8a6ab6883` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.788472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] RBAC: Authorizing `identity:create_grant(project_id=09a78bed4fac444bba365f738da8e411, user_id=90bb4113f250439488788939e6204036, role_id=c504cf6f193e4ddba25a02f8a6ab6883)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:07.790144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:07.807847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:07.813186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 73/150] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:07 2022] PUT /identity/v3/projects/09a78bed4fac444bba365f738da8e411/users/90bb4113f250439488788939e6204036/roles/c504cf6f193e4ddba25a02f8a6ab6883 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:07.848272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db892f-753f-4249-8bd7-08ad16419340 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:07.899518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:07.900252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:07.900533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:07.900802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:07.916653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:07.921787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:07.922788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:07.923577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 78/151] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:07.930870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:08.057715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a793376-a0d7-4c1d-ac5c-666af7a0b067 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:08.112689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:08.113766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:08.114309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:08.114787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:08.116102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:08.116811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:08.119277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:08.135174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 74/152] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:08.141231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:08.269689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e948-6d59-4165-ac2f-22621f1184c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:08.277754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:08.312384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b3b0-dedf-44c3-aa6a-d2eba06c45d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:08.312962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b3b0-dedf-44c3-aa6a-d2eba06c45d8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:08.313248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b3b0-dedf-44c3-aa6a-d2eba06c45d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:08.313509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b3b0-dedf-44c3-aa6a-d2eba06c45d8 None admin] PATH_INFO: `/v3/users/e1e471e155f146cdb2493555b6df58b4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:08.314717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b3b0-dedf-44c3-aa6a-d2eba06c45d8 None admin] RBAC: Authorizing `identity:get_user(user_id=e1e471e155f146cdb2493555b6df58b4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:08.316246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b3b0-dedf-44c3-aa6a-d2eba06c45d8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:08.318283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 79/153] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:08 2022] GET /identity/v3/users/e1e471e155f146cdb2493555b6df58b4 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:08.324005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:08.414853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c22f-7fc9-4698-9b14-2f38511a7ac0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:08.416862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c22f-7fc9-4698-9b14-2f38511a7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:08.416862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c22f-7fc9-4698-9b14-2f38511a7ac0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:08.417410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 80/154] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:08.421092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:08.426526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599428-10fe-4161-b2c6-9571f0c00a85 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:08.427109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599428-10fe-4161-b2c6-9571f0c00a85 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:08.427425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b599428-10fe-4161-b2c6-9571f0c00a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:08.467042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2b599428-10fe-4161-b2c6-9571f0c00a85 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:08.475852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2b599428-10fe-4161-b2c6-9571f0c00a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:08.517842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904930a-9341-4391-8d4a-4c9186deeeff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:08.595511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 81/155] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:08.612531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:08.613181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:08.613465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:08.613742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:08.619242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b599428-10fe-4161-b2c6-9571f0c00a85 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:08.722189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b599428-10fe-4161-b2c6-9571f0c00a85 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:08.724763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:08.759006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:08.759589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:08.760527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:08.760769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:08.761184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:08.761584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:08.772673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:08.777903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:08.779169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:08.780211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:08.782219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 82/156] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:08.788505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:08.892146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88d8d3-9826-4fdb-b284-0e65728bcaf4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:08.893112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:08.928186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:08.929137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:08.929551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:08.930000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:08.930904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:08.931354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:08.932907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:08.941734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 83/157] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:08.947620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:08.976887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:08.978845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 75/158] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:08.984199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:09.051490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85acd0-4275-474d-a585-98f06420f29c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:09.087063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:09.088476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:09.088989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:09.089405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:09.090767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:09.092516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:09.094555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 84/159] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:08 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:09.101085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:09.199681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:09.210166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1ca67-6061-424f-b0cf-0582f620986a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:09.222158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69065837-65ed-4309-aae8-5e1b03b8f348 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:09.256761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:09.257671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:09.258237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:09.258670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:09.341820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:09.342885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:09.343451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:09.343866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:09.345213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:09.352104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:09.354245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 76/160] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:08 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:09.363165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:09.447796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:09.472157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:09.473594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:09.580052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e564-7292-4388-9f1e-5c4fccd2d0c8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:09.648514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:09.649585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:09.650121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:09.650604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:09.651632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=e1e471e155f146cdb2493555b6df58b4) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:09.652136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:09.653786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:09.666642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 77/161] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:09 2022] GET /identity/v3/role_assignments?user.id=e1e471e155f146cdb2493555b6df58b4&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:09.719641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:09.727509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 85/162] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:09.733248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:09.875998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:09.883540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ea23d-3ce3-42d6-ba82-536534d2fef8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:09.932194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58b8bf-6d1c-4998-84f0-3792f5a43cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:09.933263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58b8bf-6d1c-4998-84f0-3792f5a43cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:09.933765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58b8bf-6d1c-4998-84f0-3792f5a43cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:09.934262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58b8bf-6d1c-4998-84f0-3792f5a43cf1 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:09.935698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58b8bf-6d1c-4998-84f0-3792f5a43cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:09.937483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58b8bf-6d1c-4998-84f0-3792f5a43cf1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:09.939551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 78/163] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:09 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:09.945839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:10.064159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ee8a-3b16-423a-aab0-d999ad93c36f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.065026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ee8a-3b16-423a-aab0-d999ad93c36f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.065500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ee8a-3b16-423a-aab0-d999ad93c36f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.067156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 79/164] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:10.068776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926ab09-df25-48be-82e6-8b0bcd205370 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:10.073016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356a3e-1b00-47f0-8e0a-9a08bb72c4a9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.073581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356a3e-1b00-47f0-8e0a-9a08bb72c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.074087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356a3e-1b00-47f0-8e0a-9a08bb72c4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.103911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-43356a3e-1b00-47f0-8e0a-9a08bb72c4a9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:10.107481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-43356a3e-1b00-47f0-8e0a-9a08bb72c4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:10.148156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:10.149187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.149725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.150209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.151232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=8fd98010f65d42aeb277ffa7a796efbf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:10.152603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:10.154338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:10.166572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 86/165] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:09 2022] GET /identity/v3/role_assignments?user.id=8fd98010f65d42aeb277ffa7a796efbf&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=96d2ad5552c34a6799019f0c9786745b => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:10.212917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 80/166] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:10.253732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:10.318541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:10.376372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4872b8-8f53-4f6e-bbfb-1f973d6c8a27 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:10.422816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:10.423881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.424385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.424854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.439880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:10.446634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:10.447565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:10.448597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 87/167] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:10.450331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c53735-6a99-4945-a4b5-603894478326 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.451178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c53735-6a99-4945-a4b5-603894478326 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.451662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c53735-6a99-4945-a4b5-603894478326 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.453443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 81/168] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:10.455135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:10.463875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef8f0-c826-4784-8f2b-1368b6518d26 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.464487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef8f0-c826-4784-8f2b-1368b6518d26 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.464967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef8f0-c826-4784-8f2b-1368b6518d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.496429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b14ef8f0-c826-4784-8f2b-1368b6518d26 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:10.498068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b14ef8f0-c826-4784-8f2b-1368b6518d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:10.635852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99203374-e7e8-4877-84c8-7472d53b8437 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:10.670344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 82/169] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:10.670531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:10.678430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:10.679071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.679357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.679692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.680430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:10.680787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:10.682254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:10.694551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 88/170] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:10.697237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ef8f0-c826-4784-8f2b-1368b6518d26 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:10.719396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:10.733091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:10.904411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ef8f0-c826-4784-8f2b-1368b6518d26 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:10.931192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb39be-31cf-408d-89e9-c5736e229413 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:10.982413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:10.983198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:10.983475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:10.983744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:10.991460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:10.993182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:10.995080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 83/171] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:10 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:11.000361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:11.008879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:11.009555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.009822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.010122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.038533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:11.045843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:11.046728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:11.047492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 89/172] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:11.056874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:11.157602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:11.222799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:11.243770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060c57f-7ab7-49cd-83bd-1aae6a94cfe8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:11.285120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcd465-2198-4f5b-a593-1a41b48b7d04 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:11.309962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9333d08-ca0a-475c-bd31-6392d546a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:11.310614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333d08-ca0a-475c-bd31-6392d546a33e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.310887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333d08-ca0a-475c-bd31-6392d546a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.311153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9333d08-ca0a-475c-bd31-6392d546a33e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.352960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4776447-8f82-4f70-ad88-c598f39a836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:11.353637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4776447-8f82-4f70-ad88-c598f39a836b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.353916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4776447-8f82-4f70-ad88-c598f39a836b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.354209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4776447-8f82-4f70-ad88-c598f39a836b None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.354983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4776447-8f82-4f70-ad88-c598f39a836b None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:11.355290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4776447-8f82-4f70-ad88-c598f39a836b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:11.356711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4776447-8f82-4f70-ad88-c598f39a836b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:11.376656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 90/173] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:11.387097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33c443-8717-46a5-a4b5-b2de6cba6f85 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.387462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33c443-8717-46a5-a4b5-b2de6cba6f85 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.387742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33c443-8717-46a5-a4b5-b2de6cba6f85 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.389614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 91/174] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:11.390217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33c443-8717-46a5-a4b5-b2de6cba6f85 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:11.448413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9333d08-ca0a-475c-bd31-6392d546a33e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:11.449919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9333d08-ca0a-475c-bd31-6392d546a33e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:11.539168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33c443-8717-46a5-a4b5-b2de6cba6f85 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:11.541443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:11.578462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac0bb6-4aa9-4f28-a820-16abf2088f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:11.579409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac0bb6-4aa9-4f28-a820-16abf2088f02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.579892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac0bb6-4aa9-4f28-a820-16abf2088f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.580306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac0bb6-4aa9-4f28-a820-16abf2088f02 None admin] PATH_INFO: `/v3/users/8fd98010f65d42aeb277ffa7a796efbf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.582181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac0bb6-4aa9-4f28-a820-16abf2088f02 None admin] RBAC: Authorizing `identity:get_user(user_id=8fd98010f65d42aeb277ffa7a796efbf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:11.584643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac0bb6-4aa9-4f28-a820-16abf2088f02 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:11.586953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 92/175] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:11 2022] GET /identity/v3/users/8fd98010f65d42aeb277ffa7a796efbf => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:11.592976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8be1c-c786-4b71-92cb-e679782e3797 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.592976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8be1c-c786-4b71-92cb-e679782e3797 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.592976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8be1c-c786-4b71-92cb-e679782e3797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.613386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-33b8be1c-c786-4b71-92cb-e679782e3797 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:11.615145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-33b8be1c-c786-4b71-92cb-e679782e3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:11.641905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:11.655002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 84/176] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:11.656351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242cabd-3b92-49ff-842f-903563e6e921 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.656632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242cabd-3b92-49ff-842f-903563e6e921 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.656904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242cabd-3b92-49ff-842f-903563e6e921 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.658197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 85/177] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:11.658887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242cabd-3b92-49ff-842f-903563e6e921 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:11.689046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 93/178] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:11.690426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a5ef-6432-4568-8e7b-f0163eab3cf5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.690774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a5ef-6432-4568-8e7b-f0163eab3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.691054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6a5ef-6432-4568-8e7b-f0163eab3cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.709254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-48e6a5ef-6432-4568-8e7b-f0163eab3cf5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:11.710479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-48e6a5ef-6432-4568-8e7b-f0163eab3cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:11.775789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242cabd-3b92-49ff-842f-903563e6e921 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:11.778739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 94/179] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:11.779421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a5ef-6432-4568-8e7b-f0163eab3cf5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:11.816093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:11.817877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:11.818634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.818936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.819253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.879392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:11.885995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6a5ef-6432-4568-8e7b-f0163eab3cf5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:11.889890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:11.891451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:11.918582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac575e-7f78-4107-8f29-4ae1876a4721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:11.919234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac575e-7f78-4107-8f29-4ae1876a4721 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.919513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac575e-7f78-4107-8f29-4ae1876a4721 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.919788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac575e-7f78-4107-8f29-4ae1876a4721 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.920956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac575e-7f78-4107-8f29-4ae1876a4721 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:11.922455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac575e-7f78-4107-8f29-4ae1876a4721 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:11.924131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 95/180] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:11 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:11.925240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475665-e4f7-46d7-a95f-aea3fc5b73f8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:11.925517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475665-e4f7-46d7-a95f-aea3fc5b73f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:11.925786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475665-e4f7-46d7-a95f-aea3fc5b73f8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:11.927218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 96/181] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:11.927769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af475665-e4f7-46d7-a95f-aea3fc5b73f8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:11.995994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 86/182] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:11.996837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.025400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.030300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af475665-e4f7-46d7-a95f-aea3fc5b73f8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.064446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54592e01-0a8b-4f11-b832-4644748e9a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.065100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592e01-0a8b-4f11-b832-4644748e9a02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.065383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592e01-0a8b-4f11-b832-4644748e9a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.065665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54592e01-0a8b-4f11-b832-4644748e9a02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.075980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54592e01-0a8b-4f11-b832-4644748e9a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-54592e01-0a8b-4f11-b832-4644748e9a02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:12.080919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:12.081889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:12.082715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 97/183] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:12.083358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1cb3e-3b6c-40d9-9ffc-2af8dca12276 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.083675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1cb3e-3b6c-40d9-9ffc-2af8dca12276 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.083885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1cb3e-3b6c-40d9-9ffc-2af8dca12276 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.089005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 98/184] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:12.089005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1cb3e-3b6c-40d9-9ffc-2af8dca12276 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.089200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.098710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9db7c-49fc-41d7-bfec-3af43a97db40 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.132479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d071649-6d8e-4148-895b-c937c5f15ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.133126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071649-6d8e-4148-895b-c937c5f15ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.133412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071649-6d8e-4148-895b-c937c5f15ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.133671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d071649-6d8e-4148-895b-c937c5f15ed6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.144448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d071649-6d8e-4148-895b-c937c5f15ed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-9d071649-6d8e-4148-895b-c937c5f15ed6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:12.149420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:12.150360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:12.151146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 87/185] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:12.151801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ea02-c6ca-42b7-ad6c-6d07f111024e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.152123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ea02-c6ca-42b7-ad6c-6d07f111024e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.152219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228ea02-c6ca-42b7-ad6c-6d07f111024e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.169563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4228ea02-c6ca-42b7-ad6c-6d07f111024e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:12.170781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4228ea02-c6ca-42b7-ad6c-6d07f111024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:12.191358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea1cb3e-3b6c-40d9-9ffc-2af8dca12276 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.224972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.225598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.225879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.226264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.227073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] RBAC: Adding query filter params (role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=8fd98010f65d42aeb277ffa7a796efbf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:12.227386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.228910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.234835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 99/186] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/role_assignments?user.id=8fd98010f65d42aeb277ffa7a796efbf&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.235600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.237997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 88/187] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:12.238823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ea02-c6ca-42b7-ad6c-6d07f111024e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.273392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.340499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.362523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228ea02-c6ca-42b7-ad6c-6d07f111024e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.362742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90c661-5ba4-4a1a-a68f-64a0b6446000 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.398617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5fd61-3c9a-42fa-92c0-140c0f026274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.399270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5fd61-3c9a-42fa-92c0-140c0f026274 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.399550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5fd61-3c9a-42fa-92c0-140c0f026274 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.399822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5fd61-3c9a-42fa-92c0-140c0f026274 None admin] PATH_INFO: `/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.400643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.400986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5fd61-3c9a-42fa-92c0-140c0f026274 None admin] RBAC: Authorizing `identity:get_project(project_id=585da9c974aa49dbb49f28bce5e7f6b1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.401098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.401554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.401834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.402496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5fd61-3c9a-42fa-92c0-140c0f026274 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.402594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:12.402886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.409815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 100/188] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/projects/585da9c974aa49dbb49f28bce5e7f6b1 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.409970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.410075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13736a-5722-45e5-90a3-0767cd522be9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.410075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13736a-5722-45e5-90a3-0767cd522be9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.410075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13736a-5722-45e5-90a3-0767cd522be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.418876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 89/189] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.419547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.431284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7e13736a-5722-45e5-90a3-0767cd522be9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:12.432505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7e13736a-5722-45e5-90a3-0767cd522be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:12.507879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 101/190] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:12.514832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13736a-5722-45e5-90a3-0767cd522be9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.533493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccefb7-b9cd-4826-9ecd-2196f70cf922 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.537193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.567667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.568314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.568589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.568890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.569606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:12.569914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.571313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.579288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 90/191] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.580067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.584099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.616339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13736a-5722-45e5-90a3-0767cd522be9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.650744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.651387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.651658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.651925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.662226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:12.667082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:12.668015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:12.668810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 102/192] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:12.669483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.688025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d236c-ebaf-4c08-a99d-83d57cef1a53 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.721294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.721910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.722230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.722499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.723345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=585da9c974aa49dbb49f28bce5e7f6b1, user.id=8fd98010f65d42aeb277ffa7a796efbf) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:12.723644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.725099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.730802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 91/193] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/role_assignments?user.id=8fd98010f65d42aeb277ffa7a796efbf&scope.project.id=585da9c974aa49dbb49f28bce5e7f6b1&role.id=96d2ad5552c34a6799019f0c9786745b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.731559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.749175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.771331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbbba2-35fc-480e-bf87-4ec22973de30 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.808607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:12.812884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.814060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.814634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.815043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] PATH_INFO: `/v3/users/bc8164ecb6cb419585c387693450c4b2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.836461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=bc8164ecb6cb419585c387693450c4b2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.838288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.840380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 103/194] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/users/bc8164ecb6cb419585c387693450c4b2 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.841146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.855891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217622a-8ae0-4a08-9ed9-c3fb486f0c42 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.899937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.899937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.900224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.900323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.901434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.902931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.904542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 92/195] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.905304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:12.952887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4429b-0ea0-45eb-a950-defc7aa4c3d7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:12.988278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:12.988935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:12.989217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:12.989491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] PATH_INFO: `/v3/users/90bb4113f250439488788939e6204036` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:12.990714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] RBAC: Authorizing `identity:get_user(user_id=90bb4113f250439488788939e6204036)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:12.992198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:12.993813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 104/196] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/users/90bb4113f250439488788939e6204036 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:12.996897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.003326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.023045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366bb91-aa97-4c0b-89a7-f72694e233da None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.057594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.058249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.058525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.058846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.059517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:13.059821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.061198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.063394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.070734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 93/197] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:13.071658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.095907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26490531-1285-4d77-b3c6-4dc2ea1d13c2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.128263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.128882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.129159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.129430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.170190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8564-b246-4a79-9552-0af778e9b9a3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.197687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.199233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.202550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.203167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.203440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.203711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.204388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.205810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.206629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.227968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 94/198] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:13 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:13.235058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.297634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.310489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 105/199] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:13.311678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.356666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa497a-91fe-4603-9a86-c6c3e296d37a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.395125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.395764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.396046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.396358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.425523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474e76e-8bb4-4441-9af8-d89c972b0f55 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.433698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.472538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.473201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.473484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.473760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] PATH_INFO: `/v3/users/bc8164ecb6cb419585c387693450c4b2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.475113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=bc8164ecb6cb419585c387693450c4b2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.476608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.478616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 106/200] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:13 2022] GET /identity/v3/users/bc8164ecb6cb419585c387693450c4b2 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:13.479413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.483842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.485343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.552970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.603842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd75d1-c15b-4753-94bc-4191c0141ea3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.609728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 95/201] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:13.614659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.644016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.644759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.644956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.645228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.646482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.648037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.650153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 107/202] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:13 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:13.654702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.702229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.747373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42b6e6-7f7d-4b33-a5b0-00f610b67dff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.764335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71038e1-2088-4177-aa85-b0afe8159e47 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.795992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.797301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.797747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.798215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.800747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.801476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.801826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.802214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.803567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.805038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.806842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 108/203] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:13 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:13.807673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:13.887607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.890148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.902282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.923160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a17e6c-1c5f-4f3e-a4dc-d2498b062455 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:13.938118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:13.969331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:13.970354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:13.971226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:13.971698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:13.973248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=bc8164ecb6cb419585c387693450c4b2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:13.973825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:13.976246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:13.984037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 109/204] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:13 2022] GET /identity/v3/role_assignments?user.id=bc8164ecb6cb419585c387693450c4b2&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:13.985052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:14.013539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 96/205] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:14.019261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:14.104865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b95ea8-f13f-48b9-9b78-7cf6496f9bfa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:14.133256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:14.151511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:14.152573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:14.153023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:14.153469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:14.154769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] RBAC: Adding query filter params (role.id=c504cf6f193e4ddba25a02f8a6ab6883, scope.project.id=09a78bed4fac444bba365f738da8e411, user.id=90bb4113f250439488788939e6204036) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:14.155262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:14.156930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:14.165085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 110/206] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:13 2022] GET /identity/v3/role_assignments?user.id=90bb4113f250439488788939e6204036&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=c504cf6f193e4ddba25a02f8a6ab6883 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:14.209830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d714e29-e090-4877-b537-04b27f7479cf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:14.261175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4173a-e2b4-4384-9770-9c4ee2d08d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:14.261879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4173a-e2b4-4384-9770-9c4ee2d08d60 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:14.262208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4173a-e2b4-4384-9770-9c4ee2d08d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:14.262479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4173a-e2b4-4384-9770-9c4ee2d08d60 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:14.266924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4173a-e2b4-4384-9770-9c4ee2d08d60 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:14.268458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4173a-e2b4-4384-9770-9c4ee2d08d60 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:14.270356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 97/207] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:14 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:14.276976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:14.322185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:14.387475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451ee66-fcbe-467a-8522-0874303a2c93 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:14.423225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f5409-75bc-44ef-ab34-1d90396e08c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:14.423869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5409-75bc-44ef-ab34-1d90396e08c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:14.424148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5409-75bc-44ef-ab34-1d90396e08c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:14.424421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f5409-75bc-44ef-ab34-1d90396e08c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:14.425213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f5409-75bc-44ef-ab34-1d90396e08c4 None admin] RBAC: Adding query filter params (role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=bc8164ecb6cb419585c387693450c4b2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:14.425515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f5409-75bc-44ef-ab34-1d90396e08c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:14.427033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f5409-75bc-44ef-ab34-1d90396e08c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:14.433246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 111/208] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:14 2022] GET /identity/v3/role_assignments?user.id=bc8164ecb6cb419585c387693450c4b2&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:15.382113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23180-cba4-4764-b21f-dcae22281562 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:15.382682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23180-cba4-4764-b21f-dcae22281562 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:15.382682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23180-cba4-4764-b21f-dcae22281562 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:15.384138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 98/209] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:15.389590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6227e-bd9e-44df-ad40-ee237ebe44a4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:15.390025 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6227e-bd9e-44df-ad40-ee237ebe44a4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:15.390165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6227e-bd9e-44df-ad40-ee237ebe44a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:15.411185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6ac6227e-bd9e-44df-ad40-ee237ebe44a4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:15.412660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ac6227e-bd9e-44df-ad40-ee237ebe44a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:15.479953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 112/210] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:15.502241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23180-cba4-4764-b21f-dcae22281562 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:15.544272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b397-9ef6-4064-9812-464b396883fe None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:15.544857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b397-9ef6-4064-9812-464b396883fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:15.545833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b397-9ef6-4064-9812-464b396883fe None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:15.547868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 113/211] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:15.553133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e6317-d50e-476b-8183-72a088e0b41f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:15.553643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e6317-d50e-476b-8183-72a088e0b41f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:15.554183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e6317-d50e-476b-8183-72a088e0b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:15.572056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d65e6317-d50e-476b-8183-72a088e0b41f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:15.573519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d65e6317-d50e-476b-8183-72a088e0b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:15.612459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23180-cba4-4764-b21f-dcae22281562 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:15.634498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:15.636178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:15.647749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 114/212] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:15.654174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:15.654174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:15.654174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:15.654174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:15.665816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:15.670911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:15.671767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:15.672557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:15.677420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 99/213] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:15.678467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e6317-d50e-476b-8183-72a088e0b41f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:15.679113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:15.802013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e6317-d50e-476b-8183-72a088e0b41f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:15.805858 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4327196-0969-420f-8a2c-2e0a016ba397 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:15.844849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:15.845505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:15.845783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:15.846097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:15.847228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:15.848016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:15.848694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:15.849211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:15.849685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:15.850197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:15.851102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:15.856001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 115/214] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:15.856139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:15.856139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:15.858292 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:15.866868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 100/215] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:15.872403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:15.897730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:15.930560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:15.987630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc57640-4d1a-49c1-8bab-3e2dad2f66f7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:15.999370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de0f3f-70bd-4727-9a97-8409a7c29f5d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:16.031699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.032355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.033077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.033360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.034689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:16.036432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:16.042129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20f101-da5c-41ea-aa90-ff7f58be7606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.043046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20f101-da5c-41ea-aa90-ff7f58be7606 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.043511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20f101-da5c-41ea-aa90-ff7f58be7606 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.043966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20f101-da5c-41ea-aa90-ff7f58be7606 None admin] PATH_INFO: `/v3/users/92a4f951e15944a69cc018041a7924d5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.061539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20f101-da5c-41ea-aa90-ff7f58be7606 None admin] RBAC: Authorizing `identity:get_user(user_id=92a4f951e15944a69cc018041a7924d5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:16.063220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 116/216] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:15 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:16.063760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20f101-da5c-41ea-aa90-ff7f58be7606 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:16.065800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 101/217] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:15 2022] GET /identity/v3/users/92a4f951e15944a69cc018041a7924d5 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:16.071710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:16.168830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:16.188426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c7621-39ea-4f78-b5c3-3f4434de7390 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:16.221887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644c64-261e-4876-af51-c71284f272c0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.222701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644c64-261e-4876-af51-c71284f272c0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.223555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644c64-261e-4876-af51-c71284f272c0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.225752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 102/218] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:16.231572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a705b83-a78e-40f8-9d3f-c22e480ba0b6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.232232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a705b83-a78e-40f8-9d3f-c22e480ba0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.232551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.233032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a705b83-a78e-40f8-9d3f-c22e480ba0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.233201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.233494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.233770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.259003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4a705b83-a78e-40f8-9d3f-c22e480ba0b6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:16.260754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4a705b83-a78e-40f8-9d3f-c22e480ba0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:16.319000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:16.320527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:16.351447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 103/219] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:16.373588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a705b83-a78e-40f8-9d3f-c22e480ba0b6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:16.415039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:16.428218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:16.450712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 117/220] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:07:16.456613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:16.498687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a705b83-a78e-40f8-9d3f-c22e480ba0b6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:16.544578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416bf17a-9b8f-49e7-9baa-f2f20c2c7659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.545236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf17a-9b8f-49e7-9baa-f2f20c2c7659 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.545512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf17a-9b8f-49e7-9baa-f2f20c2c7659 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.545780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bf17a-9b8f-49e7-9baa-f2f20c2c7659 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.560853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416bf17a-9b8f-49e7-9baa-f2f20c2c7659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-416bf17a-9b8f-49e7-9baa-f2f20c2c7659 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:16.565851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:16.566795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:16.567603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 104/221] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:16.568377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d668-020d-4d21-9614-686f1aff2f9d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.568729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d668-020d-4d21-9614-686f1aff2f9d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.569006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69d668-020d-4d21-9614-686f1aff2f9d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.570445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 105/222] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:16.575155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d668-020d-4d21-9614-686f1aff2f9d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:16.589039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aee7b4-7bfb-4d62-b578-fa71edbf3d0e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:16.633911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c357ff4-a263-4f74-ae8b-2437328bf1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.634835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357ff4-a263-4f74-ae8b-2437328bf1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.635249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357ff4-a263-4f74-ae8b-2437328bf1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.635652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c357ff4-a263-4f74-ae8b-2437328bf1d3 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.637485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c357ff4-a263-4f74-ae8b-2437328bf1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:16.639639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c357ff4-a263-4f74-ae8b-2437328bf1d3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:16.642664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 118/223] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:16.649018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8bed1-55eb-41f2-b3bc-d3b7fbbebdf4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.649018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8bed1-55eb-41f2-b3bc-d3b7fbbebdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.649018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8bed1-55eb-41f2-b3bc-d3b7fbbebdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.668516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2dc8bed1-55eb-41f2-b3bc-d3b7fbbebdf4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:16.669852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2dc8bed1-55eb-41f2-b3bc-d3b7fbbebdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:16.691281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:16.705706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69d668-020d-4d21-9614-686f1aff2f9d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:16.725017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:16.748754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 119/224] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:16.749648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8bed1-55eb-41f2-b3bc-d3b7fbbebdf4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:16.751734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.752787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.753260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.753725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.754669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:16.755164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:16.756812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:16.767760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 106/225] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:16.773197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:16.873597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8bed1-55eb-41f2-b3bc-d3b7fbbebdf4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:16.903375 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361996b0-0c54-45ba-a619-8970156971c4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:16.912589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.913988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.914894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.915483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.916558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=92a4f951e15944a69cc018041a7924d5) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:16.917081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:16.919624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:16.934183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 120/226] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/role_assignments?user.id=92a4f951e15944a69cc018041a7924d5&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=96d2ad5552c34a6799019f0c9786745b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:16.934183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:16.960017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:16.960687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:16.960971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:16.961240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] PATH_INFO: `/v3/users/bc8164ecb6cb419585c387693450c4b2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:16.962709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] RBAC: Authorizing `identity:get_user(user_id=bc8164ecb6cb419585c387693450c4b2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:16.965319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:16.967133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 107/227] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/users/bc8164ecb6cb419585c387693450c4b2 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:16.973115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:17.023802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:17.031282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:17.134046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69027c-ced9-441c-93e5-f7408073f475 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:17.170825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0542-dca9-4281-902b-d908ab02ee0c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:17.186677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:17.187346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:17.187622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:17.187893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:17.206831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:17.214848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:17.215716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:17.216478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 121/228] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:17.221889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:17.236805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:17.237518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:17.237795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:17.238125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:17.239399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:17.241040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:17.242824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 108/229] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:16 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:17.248533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:17.387682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bc48-28e9-4e0a-a060-4c1b773c21b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:17.398261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:17.430289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:17.447300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:17.449281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:17.449564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:17.449832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:17.450597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:17.450904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:17.452326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:17.454229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa74614-9187-43ec-b49a-bfd53567b2c8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:17.471812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 122/230] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:17.476326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:17.503479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:17.504549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:17.505130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:17.505699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a/users/bc8164ecb6cb419585c387693450c4b2/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:17.507908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f47d375130964aa590995b8d7151684a, user_id=bc8164ecb6cb419585c387693450c4b2, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:17.509574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:17.542492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 109/231] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:17 2022] PUT /identity/v3/projects/f47d375130964aa590995b8d7151684a/users/bc8164ecb6cb419585c387693450c4b2/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:17.606493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38444ab9-675d-4a43-90eb-197629e0be92 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:17.645243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:17.646062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:17.646348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:17.646668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] PATH_INFO: `/v3/users/bc8164ecb6cb419585c387693450c4b2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:17.648008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] RBAC: Authorizing `identity:get_user(user_id=bc8164ecb6cb419585c387693450c4b2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:17.649502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:17.651202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 123/232] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:17 2022] GET /identity/v3/users/bc8164ecb6cb419585c387693450c4b2 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:17.657051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:17.787069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e726-0b2a-49f2-89ee-2049235bf6d8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:17.823863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c7836-14ac-4721-ae24-7febbe964216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:17.824949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c7836-14ac-4721-ae24-7febbe964216 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:17.825429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c7836-14ac-4721-ae24-7febbe964216 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:17.825902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c7836-14ac-4721-ae24-7febbe964216 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:17.827326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c7836-14ac-4721-ae24-7febbe964216 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:17.828995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c7836-14ac-4721-ae24-7febbe964216 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:17.831211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 110/233] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:17 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:17.836875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:17.883139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:17.951751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe2729-8f89-408f-94f0-3b1014dad5e7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:17.997439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cea3c9e-4e35-4533-81b2-4bfb71fd543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:17.998181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea3c9e-4e35-4533-81b2-4bfb71fd543e None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:17.998464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea3c9e-4e35-4533-81b2-4bfb71fd543e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:17.998738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea3c9e-4e35-4533-81b2-4bfb71fd543e None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a/users/bc8164ecb6cb419585c387693450c4b2/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:18.003815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea3c9e-4e35-4533-81b2-4bfb71fd543e None admin] RBAC: Authorizing `identity:create_grant(project_id=f47d375130964aa590995b8d7151684a, user_id=bc8164ecb6cb419585c387693450c4b2, role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:18.005496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cea3c9e-4e35-4533-81b2-4bfb71fd543e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:18.022094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 124/234] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:17 2022] PUT /identity/v3/projects/f47d375130964aa590995b8d7151684a/users/bc8164ecb6cb419585c387693450c4b2/roles/063bbdfce3224ede93cacead71ab0bfa => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:18.427619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ec01-ed6b-4c95-af69-9eb57d07f032 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:18.428369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ec01-ed6b-4c95-af69-9eb57d07f032 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:18.428876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8ec01-ed6b-4c95-af69-9eb57d07f032 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:18.430570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 111/235] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:18.435967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68991cd-0b0b-4ec3-924b-d7cb0e6ca9e4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:18.436482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68991cd-0b0b-4ec3-924b-d7cb0e6ca9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:18.436954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68991cd-0b0b-4ec3-924b-d7cb0e6ca9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:18.458059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f68991cd-0b0b-4ec3-924b-d7cb0e6ca9e4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:18.460202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f68991cd-0b0b-4ec3-924b-d7cb0e6ca9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:18.561575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 125/236] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:18.594763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2c98b-4cd8-448f-91e0-d79864b36e57 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:18.595406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2c98b-4cd8-448f-91e0-d79864b36e57 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:18.595910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2c98b-4cd8-448f-91e0-d79864b36e57 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:18.597488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 112/237] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:18.598810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68991cd-0b0b-4ec3-924b-d7cb0e6ca9e4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:18.602993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc41cc6-ceaf-4529-97e9-bbdf2d8d8824 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:18.603528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc41cc6-ceaf-4529-97e9-bbdf2d8d8824 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:18.604018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc41cc6-ceaf-4529-97e9-bbdf2d8d8824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:18.625724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cbc41cc6-ceaf-4529-97e9-bbdf2d8d8824 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:18.627470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cbc41cc6-ceaf-4529-97e9-bbdf2d8d8824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:18.644487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:18.646777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:18.735413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 113/238] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:18.764444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68991cd-0b0b-4ec3-924b-d7cb0e6ca9e4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:18.774433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc41cc6-ceaf-4529-97e9-bbdf2d8d8824 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:18.829369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:18.830059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:18.830339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:18.830607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:18.846690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:18.851698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:18.852597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:18.853386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:18.855696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 126/239] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:18.867099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:18.937619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc41cc6-ceaf-4529-97e9-bbdf2d8d8824 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:18.999317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:18.999899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.000184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.000455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.003402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:19.004870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:19.006597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 114/240] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:19.013774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:19.031030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:19.048291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:19.054559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523698a-71b2-4b20-86c0-205cb2879134 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:19.124249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:19.125264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.125691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.126175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.127062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:19.127543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:19.129159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:19.144837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 127/241] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:19.150664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:19.176248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd267db-3735-4fc3-b0ea-b867cf416788 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:19.240745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:19.241628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.242155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.243017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.244482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:19.247530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:19.288377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 115/242] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:19 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:19.327062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d395a8-f310-4460-ad3f-bb71a2b1abdd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:19.373762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34dea5-1aad-4e5e-b389-e35e092585f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:19.374511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34dea5-1aad-4e5e-b389-e35e092585f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.374792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34dea5-1aad-4e5e-b389-e35e092585f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.375065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34dea5-1aad-4e5e-b389-e35e092585f8 None admin] PATH_INFO: `/v3/users/a8cc915362a84dae8bee56ee55a9a960` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.395508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34dea5-1aad-4e5e-b389-e35e092585f8 None admin] RBAC: Authorizing `identity:get_user(user_id=a8cc915362a84dae8bee56ee55a9a960)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:19.397132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34dea5-1aad-4e5e-b389-e35e092585f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:19.399249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 128/243] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:19 2022] GET /identity/v3/users/a8cc915362a84dae8bee56ee55a9a960 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:19.405096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:19.518390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:19.558656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55491169-d015-4737-a004-85fbaab63a5b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:19.592958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:19.593599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.593878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.594181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.627041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977d24c-5a43-45e2-bd9e-b8818c829698 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.627559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977d24c-5a43-45e2-bd9e-b8818c829698 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.627559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977d24c-5a43-45e2-bd9e-b8818c829698 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.629459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 129/244] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:19.635544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341f5d-7e53-4e79-ace8-bd7729df189d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.635823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341f5d-7e53-4e79-ace8-bd7729df189d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.636099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62341f5d-7e53-4e79-ace8-bd7729df189d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.660108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-62341f5d-7e53-4e79-ace8-bd7729df189d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:19.661834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-62341f5d-7e53-4e79-ace8-bd7729df189d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:19.664889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:19.680032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:19.681522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:19.766159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 130/245] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:19.782994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:19.795059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62341f5d-7e53-4e79-ace8-bd7729df189d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:19.819219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 116/246] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:19.824689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:19.943896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62341f5d-7e53-4e79-ace8-bd7729df189d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:19.948359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0240e-a32e-4f18-ae94-b763f4d56421 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:19.995854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:19.996989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.997119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:19.997612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.997717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:19.998017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:19.998293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:19.998687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.000647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:20.002886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:20.005211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 117/247] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:19 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:20.008829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:20.011704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:20.022965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:20.028143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:20.029028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:20.029958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:20.030582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 131/248] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:20.036365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:20.099523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:20.183057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9a561-363a-4169-a326-f01803181d0a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:20.201914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a07b2-2cac-41a3-9c1c-6650d32afb3a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:20.217872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe72fd-3ccc-496f-a5f0-b89573bd1834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:20.218540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe72fd-3ccc-496f-a5f0-b89573bd1834 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.218820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe72fd-3ccc-496f-a5f0-b89573bd1834 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.219093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe72fd-3ccc-496f-a5f0-b89573bd1834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.219892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe72fd-3ccc-496f-a5f0-b89573bd1834 None admin] RBAC: Adding query filter params (role.id=c504cf6f193e4ddba25a02f8a6ab6883, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=a8cc915362a84dae8bee56ee55a9a960) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:20.220202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe72fd-3ccc-496f-a5f0-b89573bd1834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:20.221777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe72fd-3ccc-496f-a5f0-b89573bd1834 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:20.227815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 118/249] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:20 2022] GET /identity/v3/role_assignments?user.id=a8cc915362a84dae8bee56ee55a9a960&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=c504cf6f193e4ddba25a02f8a6ab6883 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:20.229036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fb540-f8d7-4059-9f58-009a30852474 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.229324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fb540-f8d7-4059-9f58-009a30852474 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.229597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fb540-f8d7-4059-9f58-009a30852474 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.235605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 119/250] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:20.241129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5bf43-d61d-49f7-b19d-1ab202af2dd7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.241430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5bf43-d61d-49f7-b19d-1ab202af2dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.241685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5bf43-d61d-49f7-b19d-1ab202af2dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.272846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b7c5bf43-d61d-49f7-b19d-1ab202af2dd7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:20.274186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b7c5bf43-d61d-49f7-b19d-1ab202af2dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:20.291701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:20.292344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.292620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.292889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.293617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:20.294038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:20.295482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:20.318201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 132/251] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:20.335092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:20.387421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 120/252] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:20.419177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5bf43-d61d-49f7-b19d-1ab202af2dd7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:20.486626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:20.506287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:20.550344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432245f4-46cb-42c9-942b-e16f5c8bf63a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:20.590688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb83fe-b635-493f-963b-4c695c293e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:20.591424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb83fe-b635-493f-963b-4c695c293e98 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.591598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5bf43-d61d-49f7-b19d-1ab202af2dd7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:20.592016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb83fe-b635-493f-963b-4c695c293e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.592016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb83fe-b635-493f-963b-4c695c293e98 None admin] PATH_INFO: `/v3/users/92a4f951e15944a69cc018041a7924d5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.593540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb83fe-b635-493f-963b-4c695c293e98 None admin] RBAC: Authorizing `identity:get_user(user_id=92a4f951e15944a69cc018041a7924d5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:20.596009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb83fe-b635-493f-963b-4c695c293e98 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:20.597677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 133/253] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:20 2022] GET /identity/v3/users/92a4f951e15944a69cc018041a7924d5 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:20.598910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dfa96-5832-4154-b0f0-704597c7406c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.599218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dfa96-5832-4154-b0f0-704597c7406c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.599487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dfa96-5832-4154-b0f0-704597c7406c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.606413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 134/254] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:20.607230 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dfa96-5832-4154-b0f0-704597c7406c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:20.653061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275f1f-4034-4f9a-a2f5-8114cd1654cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:20.653643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275f1f-4034-4f9a-a2f5-8114cd1654cd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.653918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275f1f-4034-4f9a-a2f5-8114cd1654cd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.654212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275f1f-4034-4f9a-a2f5-8114cd1654cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.677551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35275f1f-4034-4f9a-a2f5-8114cd1654cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-35275f1f-4034-4f9a-a2f5-8114cd1654cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:20.687233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:20.688136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:20.688913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:20.693962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 121/255] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:20.693962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad3a0-e2d2-43ea-a135-c53f06430764 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.693962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad3a0-e2d2-43ea-a135-c53f06430764 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.693962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ad3a0-e2d2-43ea-a135-c53f06430764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.730539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0a6ad3a0-e2d2-43ea-a135-c53f06430764 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:20.731743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0a6ad3a0-e2d2-43ea-a135-c53f06430764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:20.802630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dfa96-5832-4154-b0f0-704597c7406c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:20.854255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:20.868770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:20.869435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:20.869715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:20.870010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:20.871876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 122/256] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:20.872779 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ad3a0-e2d2-43ea-a135-c53f06430764 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:20.875522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:20.877008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:20.879809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 135/257] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:20 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:20.886184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:20.922189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:21.027357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ad3a0-e2d2-43ea-a135-c53f06430764 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.033445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639d370-acb6-4fd5-9596-7328b692bdb5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.062074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.062746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.063027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.063301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:21.064087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:21.064403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:21.065908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:21.074581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 123/258] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:21.075483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:21.134646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.135693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.136185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.136647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a/users/92a4f951e15944a69cc018041a7924d5/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:21.142692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] RBAC: Authorizing `identity:create_grant(project_id=f47d375130964aa590995b8d7151684a, user_id=92a4f951e15944a69cc018041a7924d5, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:21.144419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:21.165426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:21.176762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 136/259] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:20 2022] PUT /identity/v3/projects/f47d375130964aa590995b8d7151684a/users/92a4f951e15944a69cc018041a7924d5/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:21.177962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:21.181606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f897-65c1-4615-980a-1b45776311b3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.219458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.220344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.220714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.221084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:21.232771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:21.238521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:21.239538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:21.240318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:21.241077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 124/260] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:21.247131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:21.279205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:21.367123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86007fa0-fc19-4ab6-bfd8-f359b4f691ed None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.457290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.458409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.458980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.459441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] PATH_INFO: `/v3/users/bc8164ecb6cb419585c387693450c4b2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:21.461466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] RBAC: Authorizing `identity:get_user(user_id=bc8164ecb6cb419585c387693450c4b2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:21.463250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:21.466984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636bc34-c60f-451e-9481-13e753053df3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.468082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 137/261] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:21 2022] GET /identity/v3/users/bc8164ecb6cb419585c387693450c4b2 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:21.473449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:21.532484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.535611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.536109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.536609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:21.537718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:21.539067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:21.540719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:21.559808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 125/262] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:21.563205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:21.582313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:21.651622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc1a7-c27c-4c9f-990f-837af686327f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.693508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:21.718745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.719311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.719598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.719875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:21.742155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818f98-e990-4f3f-a42c-fb8e36a9dbae None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.800253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.800923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.801206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.801489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] PATH_INFO: `/v3/users/bc8164ecb6cb419585c387693450c4b2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:21.802767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] RBAC: Authorizing `identity:get_user(user_id=bc8164ecb6cb419585c387693450c4b2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:21.804259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:21.810207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 126/263] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:21 2022] GET /identity/v3/users/bc8164ecb6cb419585c387693450c4b2 => generated 283 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:21.813493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:21.868614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:21.870187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:21.932127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a98455-fc34-4da5-a0e2-7c5306575a61 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:21.942144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:21.967221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:21.968106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:21.968527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:21.968991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.056150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:22.058475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:22.063598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 138/264] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:07:22.068985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:22.122484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:22.218322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:22.260161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 127/265] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:07:22.263825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019416bd-ebf1-4820-9239-5529550aa560 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:22.266479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:22.336132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:22.337066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.337530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.337977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.339324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:22.340944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:22.347262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 139/266] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:22 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:22.353535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:22.468034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7189bd-e840-41ca-accf-e6aae4f53436 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:22.490593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:22.500674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e97c0-d3d4-4375-8f47-ea0327941074 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:22.518984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df5d03-b94c-4fc1-913d-ee62414f2594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:22.519961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5d03-b94c-4fc1-913d-ee62414f2594 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.520379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5d03-b94c-4fc1-913d-ee62414f2594 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.520827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df5d03-b94c-4fc1-913d-ee62414f2594 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.522179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df5d03-b94c-4fc1-913d-ee62414f2594 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:22.523803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df5d03-b94c-4fc1-913d-ee62414f2594 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:22.525957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 128/267] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:22 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:22.527397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd0bb-9125-40d9-a0d1-bd649ac964a4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.527851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd0bb-9125-40d9-a0d1-bd649ac964a4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.528293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fd0bb-9125-40d9-a0d1-bd649ac964a4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.529696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 129/268] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:22.535010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fd0bb-9125-40d9-a0d1-bd649ac964a4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:22.594305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:22.602905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d684a-5cc3-48c6-a940-dbc871aadef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:22.603598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d684a-5cc3-48c6-a940-dbc871aadef6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.603905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d684a-5cc3-48c6-a940-dbc871aadef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.604147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d684a-5cc3-48c6-a940-dbc871aadef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.604957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d684a-5cc3-48c6-a940-dbc871aadef6 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=bc8164ecb6cb419585c387693450c4b2) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:22.605262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d684a-5cc3-48c6-a940-dbc871aadef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:22.606815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d684a-5cc3-48c6-a940-dbc871aadef6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:22.613727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 140/269] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:22 2022] GET /identity/v3/role_assignments?user.id=bc8164ecb6cb419585c387693450c4b2&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:22.615281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d08346-769f-4e16-9f8d-bde1b1f963cb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.615765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d08346-769f-4e16-9f8d-bde1b1f963cb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.616226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d08346-769f-4e16-9f8d-bde1b1f963cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.635122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d8d08346-769f-4e16-9f8d-bde1b1f963cb None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:22.636657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8d08346-769f-4e16-9f8d-bde1b1f963cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:22.675336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fd0bb-9125-40d9-a0d1-bd649ac964a4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:22.714475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 141/270] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:22.716405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e5a8-ba61-496f-9905-429db1ea09f4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.716881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e5a8-ba61-496f-9905-429db1ea09f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.717340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae4e5a8-ba61-496f-9905-429db1ea09f4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.719017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 142/271] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:22.727487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8a03-6c16-45ed-889e-a42d3748a894 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.727774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8a03-6c16-45ed-889e-a42d3748a894 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.728050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f8a03-6c16-45ed-889e-a42d3748a894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.742464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:22.743212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:22.743481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:22.743765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:22.744591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] RBAC: Adding query filter params (role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=bc8164ecb6cb419585c387693450c4b2) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:22.744908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:22.746600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:22.753683 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 130/272] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:22 2022] GET /identity/v3/role_assignments?user.id=bc8164ecb6cb419585c387693450c4b2&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:22.754586 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:22.770655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e13f8a03-6c16-45ed-889e-a42d3748a894 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:22.771801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e13f8a03-6c16-45ed-889e-a42d3748a894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:22.915249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 143/273] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:22.957652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8a03-6c16-45ed-889e-a42d3748a894 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:22.963192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a98f9-cd5c-4b22-ae50-8a2a5ed9967d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:22.981968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:22.985319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:23.048462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c46b3-906d-451a-9420-e290a9a3957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.049185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c46b3-906d-451a-9420-e290a9a3957a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.049972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c46b3-906d-451a-9420-e290a9a3957a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.049972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c46b3-906d-451a-9420-e290a9a3957a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.071423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c46b3-906d-451a-9420-e290a9a3957a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-798c46b3-906d-451a-9420-e290a9a3957a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:23.076916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:23.077784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:23.079035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 131/274] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:23.079902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bcd76-96d8-4e2e-a521-8243694ab8ff None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.079902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bcd76-96d8-4e2e-a521-8243694ab8ff None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.080270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bcd76-96d8-4e2e-a521-8243694ab8ff None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.081570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 132/275] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:23.086796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bcd76-96d8-4e2e-a521-8243694ab8ff None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:23.129640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f8a03-6c16-45ed-889e-a42d3748a894 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:23.173576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66551961-7b26-4499-a3dc-80644d7e681d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.174641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551961-7b26-4499-a3dc-80644d7e681d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.175142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551961-7b26-4499-a3dc-80644d7e681d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.175597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66551961-7b26-4499-a3dc-80644d7e681d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.176861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66551961-7b26-4499-a3dc-80644d7e681d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:23.178416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66551961-7b26-4499-a3dc-80644d7e681d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:23.180332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 144/276] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:23.181476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d965db-b31c-495d-817b-18a7feecfd58 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.181755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d965db-b31c-495d-817b-18a7feecfd58 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.182057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d965db-b31c-495d-817b-18a7feecfd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.202184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-15d965db-b31c-495d-817b-18a7feecfd58 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:23.203809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-15d965db-b31c-495d-817b-18a7feecfd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:23.217303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bcd76-96d8-4e2e-a521-8243694ab8ff None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:23.252741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.253475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.253755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.254169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.254887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:23.255251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:23.256662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:23.270341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 145/278] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:23.270509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 133/278] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:23.271170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d965db-b31c-495d-817b-18a7feecfd58 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:23.271284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:23.292613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:23.309192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:23.380314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d965db-b31c-495d-817b-18a7feecfd58 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:23.381108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e7727-2abe-44bf-b421-94fb70e87e0d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:23.415525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.415893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.416159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.416438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.416553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.416720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.416830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.417123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] PATH_INFO: `/v3/users/c7596896e06d4e07a6d979abbcf9f413` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.417391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:23.418893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:23.437474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] RBAC: Authorizing `identity:get_user(user_id=c7596896e06d4e07a6d979abbcf9f413)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:23.439033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:23.440764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 134/279] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:23 2022] GET /identity/v3/users/c7596896e06d4e07a6d979abbcf9f413 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:23.445652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:23.445749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 146/280] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:23 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:23.446839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:23.549368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:23.575673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:23.591014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7b3cf-0ef6-4ca8-9d32-4cd4cdc3b20d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:23.596147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686573a-d5d3-4e79-a936-b653499bc55f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:23.631026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132180d-7c6b-4805-a105-d2fdc714c430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.631683 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132180d-7c6b-4805-a105-d2fdc714c430 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.631957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132180d-7c6b-4805-a105-d2fdc714c430 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.632227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132180d-7c6b-4805-a105-d2fdc714c430 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.638699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.639330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.639611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.639926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.640776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, user.id=c7596896e06d4e07a6d979abbcf9f413, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:23.641175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:23.642682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:23.643425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132180d-7c6b-4805-a105-d2fdc714c430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:23.648782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 147/281] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 01:07:23 2022] GET /identity/v3/role_assignments?user.id=c7596896e06d4e07a6d979abbcf9f413&scope.system=all&role.id=96d2ad5552c34a6799019f0c9786745b => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a132180d-7c6b-4805-a105-d2fdc714c430 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:23.648911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:23.649743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:23.650634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 135/282] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:23.657243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:23.794979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34989a-0e43-40cf-b38e-b1bf2628d492 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:23.835544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:23.836112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.836395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.836673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.837405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:23.837715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:23.839151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:23.840909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:23.851398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 148/283] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:23.854335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef881e3-7b52-41f0-9f7a-b2c91e3e6f3d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.855119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef881e3-7b52-41f0-9f7a-b2c91e3e6f3d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.855396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef881e3-7b52-41f0-9f7a-b2c91e3e6f3d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.856873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 136/284] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:23.857690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:23.862657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83235a4d-96b3-4a7a-8cc4-8c1668f3f046 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:23.863212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83235a4d-96b3-4a7a-8cc4-8c1668f3f046 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:23.863676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83235a4d-96b3-4a7a-8cc4-8c1668f3f046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:23.885964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-83235a4d-96b3-4a7a-8cc4-8c1668f3f046 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:23.887440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-83235a4d-96b3-4a7a-8cc4-8c1668f3f046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:23.981109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 137/285] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:23.982886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27181d3-8821-4bf3-b502-d1fab356e80e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:24.018397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83235a4d-96b3-4a7a-8cc4-8c1668f3f046 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:24.020289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:24.021203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:24.021486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:24.021755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] PATH_INFO: `/v3/users/a8cc915362a84dae8bee56ee55a9a960` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:24.022971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] RBAC: Authorizing `identity:get_user(user_id=a8cc915362a84dae8bee56ee55a9a960)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:24.025281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:24.027062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 149/286] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:23 2022] GET /identity/v3/users/a8cc915362a84dae8bee56ee55a9a960 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:24.035674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:24.166392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:24.167719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:24.202545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83235a4d-96b3-4a7a-8cc4-8c1668f3f046 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:24.212681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa41a9b-743b-4184-8e7e-dea83ede3691 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:24.238838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:24.239653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:24.239944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:24.240222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:24.248638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:24.249295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:24.249574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:24.249911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:24.256819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:24.258337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:24.260421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 150/287] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:24 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:24.260990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:24.266153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:24.267055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:24.267828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 138/288] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:24.268475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:24.278405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:24.456108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8869a4-a6db-4069-b4c0-a6874a7028e2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:24.461820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c16ca-daf3-4796-b732-17c63675e430 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:24.490326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:24.505027 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:24.505783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:24.506096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:24.506424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a/users/a8cc915362a84dae8bee56ee55a9a960/roles/c504cf6f193e4ddba25a02f8a6ab6883` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:24.508802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] RBAC: Authorizing `identity:create_grant(project_id=f47d375130964aa590995b8d7151684a, user_id=a8cc915362a84dae8bee56ee55a9a960, role_id=c504cf6f193e4ddba25a02f8a6ab6883)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:24.510329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:24.525330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 151/289] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:24 2022] PUT /identity/v3/projects/f47d375130964aa590995b8d7151684a/users/a8cc915362a84dae8bee56ee55a9a960/roles/c504cf6f193e4ddba25a02f8a6ab6883 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:07:24.563630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:24.564318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:24.564597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:24.564881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:24.565647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:24.565973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:24.567501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:24.573804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:24.582078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 139/290] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:24.588202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:24.695848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52558bf-7174-4583-8236-c02096d85c7d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:24.731245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:24.731816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:24.732098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:24.732371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] PATH_INFO: `/v3/users/92a4f951e15944a69cc018041a7924d5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:24.733623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=92a4f951e15944a69cc018041a7924d5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:24.735304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:24.737619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 152/291] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:24 2022] GET /identity/v3/users/92a4f951e15944a69cc018041a7924d5 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:24.744096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:24.865499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359089c7-bc46-486d-b61e-fc4ed3045591 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:24.900917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:24.901968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:24.902441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:24.902900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:24.994784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:24.997904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:24.999480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:25.118415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 140/292] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:25.124322 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:25.206099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:25.260125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80b3d-4aaf-46fa-b2bf-6faf69400ad3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:25.300533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109cadf-b122-4767-b911-31ef0713fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:25.301236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109cadf-b122-4767-b911-31ef0713fb18 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:25.301514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109cadf-b122-4767-b911-31ef0713fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:25.301897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109cadf-b122-4767-b911-31ef0713fb18 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:25.303095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109cadf-b122-4767-b911-31ef0713fb18 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:25.304601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109cadf-b122-4767-b911-31ef0713fb18 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:25.306479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 153/293] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:25 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:25.312305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:25.412420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:25.418525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221e285-05f9-4e1d-ad72-ffe327e8407a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:25.465340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73139659-16b2-44fc-a21f-56e6cb8916b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:25.465995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139659-16b2-44fc-a21f-56e6cb8916b0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:25.466280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139659-16b2-44fc-a21f-56e6cb8916b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:25.466554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73139659-16b2-44fc-a21f-56e6cb8916b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:25.467350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139659-16b2-44fc-a21f-56e6cb8916b0 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=92a4f951e15944a69cc018041a7924d5) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:25.467664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139659-16b2-44fc-a21f-56e6cb8916b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:25.469137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73139659-16b2-44fc-a21f-56e6cb8916b0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:25.475783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 141/294] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:25 2022] GET /identity/v3/role_assignments?user.id=92a4f951e15944a69cc018041a7924d5&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=96d2ad5552c34a6799019f0c9786745b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:26.017154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d079-0456-4285-b715-e28121375313 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.017537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d079-0456-4285-b715-e28121375313 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.017735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d079-0456-4285-b715-e28121375313 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.019103 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 154/295] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:26.025192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da78ba-1683-4739-9ab7-3c1ea546f047 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.025640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da78ba-1683-4739-9ab7-3c1ea546f047 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.025733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da78ba-1683-4739-9ab7-3c1ea546f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.028619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde14955-f72f-4338-8c72-d741895b6c4c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.028903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde14955-f72f-4338-8c72-d741895b6c4c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.029166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde14955-f72f-4338-8c72-d741895b6c4c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.030829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 155/296] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:26.036333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83facca-95ee-4cc8-9ca3-9ee1234a1263 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.036603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83facca-95ee-4cc8-9ca3-9ee1234a1263 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.036875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83facca-95ee-4cc8-9ca3-9ee1234a1263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.050106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-74da78ba-1683-4739-9ab7-3c1ea546f047 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:26.051459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-74da78ba-1683-4739-9ab7-3c1ea546f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:26.057355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f83facca-95ee-4cc8-9ca3-9ee1234a1263 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:26.058538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f83facca-95ee-4cc8-9ca3-9ee1234a1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:26.132872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 156/297] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:26.133496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 142/298] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:26.135317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb09c0-603c-40b0-b347-c416248aa1a7 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.135730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb09c0-603c-40b0-b347-c416248aa1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.136131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb09c0-603c-40b0-b347-c416248aa1a7 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.143086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4d2e-2e1c-44e0-a93a-a95c848b0c56 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.143540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4d2e-2e1c-44e0-a93a-a95c848b0c56 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.143981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4d2e-2e1c-44e0-a93a-a95c848b0c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.147069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 143/299] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:26 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:26.156188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb09c0-603c-40b0-b347-c416248aa1a7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.166461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a4ab4d2e-2e1c-44e0-a93a-a95c848b0c56 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:26.167707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4ab4d2e-2e1c-44e0-a93a-a95c848b0c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:26.223134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:26.238836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 157/300] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:26.246164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab4d2e-2e1c-44e0-a93a-a95c848b0c56 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.267299 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:26.277131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb09c0-603c-40b0-b347-c416248aa1a7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.312697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.313612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.313897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.314227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.326220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:26.331200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:26.332090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:26.332881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 144/301] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:26.333577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.356854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab4d2e-2e1c-44e0-a93a-a95c848b0c56 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.395991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.396637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.396920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.397194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.407977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:26.413326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:26.414239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:26.415065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 158/302] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:26.415706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.440364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cb7a0-c1c0-4525-b066-ca981d8b8280 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.472430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:26.479402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.480255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.480538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.481165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.482463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:26.483942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:26.490072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 145/303] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:26.490072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.521265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:26.539180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325cd2ed-6c82-4fc3-941b-45360f8bf7da None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.575882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.576955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.577229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.577902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.578924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:26.579234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:26.581347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:26.594828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 159/304] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:26.594828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.606247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27acb5c-53a7-4496-9422-b80d338cc54a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.650438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.651295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.651594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.652232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.653235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:26.653553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:26.655606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:26.671733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 146/305] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:26.671733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.695830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36414d01-93cf-40e2-a050-ea7adacaf730 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.707099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:26.737530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.738229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.738516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.738789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] PATH_INFO: `/v3/groups` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.739549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:26.741043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:26.760517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 160/306] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Aug 6 01:07:26 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:26.760517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.782795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:26.810423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040aa89-4f61-4b90-938a-bfe725b67d5c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.859447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.860135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.860457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.860737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] PATH_INFO: `/v3/users/c7596896e06d4e07a6d979abbcf9f413` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.862116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] RBAC: Authorizing `identity:get_user(user_id=c7596896e06d4e07a6d979abbcf9f413)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:26.863672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:26.870634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 147/307] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/users/c7596896e06d4e07a6d979abbcf9f413 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:26.871588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.906793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506ff72-882d-434f-9729-551be45cc899 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:26.953576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:26.954301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:26.954587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:26.954962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] PATH_INFO: `/v3/users/0fd7ebb240044c549be800968966cf12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:26.971867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd7ebb240044c549be800968966cf12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:26.973360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:26.975495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 161/308] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/users/0fd7ebb240044c549be800968966cf12 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:26.980921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:26.998560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9eb87-d20d-442b-ad06-085e404e2417 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:27.011484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:27.051937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690bd5a-26ec-4124-bd39-c1e676d2c565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:27.052611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690bd5a-26ec-4124-bd39-c1e676d2c565 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.052793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690bd5a-26ec-4124-bd39-c1e676d2c565 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.053078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690bd5a-26ec-4124-bd39-c1e676d2c565 None admin] PATH_INFO: `/v3/system/users/c7596896e06d4e07a6d979abbcf9f413/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.054646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690bd5a-26ec-4124-bd39-c1e676d2c565 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c7596896e06d4e07a6d979abbcf9f413, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:27.056056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690bd5a-26ec-4124-bd39-c1e676d2c565 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:27.066079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 148/309] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Aug 6 01:07:26 2022] PUT /identity/v3/system/users/c7596896e06d4e07a6d979abbcf9f413/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:27.067621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108b9c9-f958-4222-810a-c594284a78e7 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.067905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108b9c9-f958-4222-810a-c594284a78e7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.068178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108b9c9-f958-4222-810a-c594284a78e7 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.069535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 149/310] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:27.076413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b113e-9852-4755-aef9-8143716309e1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.076737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b113e-9852-4755-aef9-8143716309e1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.081958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b113e-9852-4755-aef9-8143716309e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.097645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d593d33-7d30-4b22-9d00-51e41072ec79 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:27.100493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-062b113e-9852-4755-aef9-8143716309e1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:27.101844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-062b113e-9852-4755-aef9-8143716309e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:27.115757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:27.144265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:27.145005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.145186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.145502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.146491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] RBAC: Adding query filter params (role.id=c504cf6f193e4ddba25a02f8a6ab6883, user.id=0fd7ebb240044c549be800968966cf12, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:27.146959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:27.148589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:27.155216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 162/311] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 01:07:26 2022] GET /identity/v3/role_assignments?user.id=0fd7ebb240044c549be800968966cf12&scope.system=all&role.id=c504cf6f193e4ddba25a02f8a6ab6883 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:27.196966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 150/312] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:27.217726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:27.327161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:27.336079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481f58b-8338-4d27-bcd9-61a6237b9f6a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:27.373265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:27.374307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.374786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.375255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.385917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:27.391251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:27.392112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:27.392905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:27.395311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 163/313] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:27.405991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b113e-9852-4755-aef9-8143716309e1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:27.503500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b113e-9852-4755-aef9-8143716309e1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:27.540410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:27.541042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.541314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.541580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.542338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:27.542642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:27.544032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:27.557345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 151/314] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:27.559035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:27.669698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227a56a-e05b-419f-a520-288fe0569591 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:27.704858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:27.705507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.705789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.706093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] PATH_INFO: `/v3/users/a8cc915362a84dae8bee56ee55a9a960` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.707279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] RBAC: Authorizing `identity:get_user(user_id=a8cc915362a84dae8bee56ee55a9a960)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:27.708819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:27.710948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 164/315] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:27 2022] GET /identity/v3/users/a8cc915362a84dae8bee56ee55a9a960 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:27.716258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:27.727791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:27.820752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eea13-c19a-4b10-af1e-3fb0375e50b9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:27.855534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:27.856517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:27.856987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:27.857467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:27.927077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:27.928547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:27.938340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:28.030050 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 152/316] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:28.032000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:28.056179 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:28.137247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087173c4-cb36-4853-8c0c-e4144a3395f0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:28.173569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5a435-caa6-4c75-8ded-d6d4b8945089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:28.174345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a435-caa6-4c75-8ded-d6d4b8945089 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:28.174582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a435-caa6-4c75-8ded-d6d4b8945089 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:28.174857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a435-caa6-4c75-8ded-d6d4b8945089 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:28.176428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5a435-caa6-4c75-8ded-d6d4b8945089 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:28.178584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5a435-caa6-4c75-8ded-d6d4b8945089 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:28.180272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 165/317] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:28 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:28.185973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:28.292631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357084c2-cc38-4d21-b177-ccaf2628df67 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:28.303175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:28.327875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c01f56-6d99-49e3-a35e-053fa79233fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:28.328500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01f56-6d99-49e3-a35e-053fa79233fb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:28.328827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01f56-6d99-49e3-a35e-053fa79233fb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:28.329103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c01f56-6d99-49e3-a35e-053fa79233fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:28.329889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01f56-6d99-49e3-a35e-053fa79233fb None admin] RBAC: Adding query filter params (role.id=c504cf6f193e4ddba25a02f8a6ab6883, scope.project.id=f47d375130964aa590995b8d7151684a, user.id=a8cc915362a84dae8bee56ee55a9a960) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:28.330234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01f56-6d99-49e3-a35e-053fa79233fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:28.332021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c01f56-6d99-49e3-a35e-053fa79233fb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:28.342055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 153/318] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:28 2022] GET /identity/v3/role_assignments?user.id=a8cc915362a84dae8bee56ee55a9a960&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=c504cf6f193e4ddba25a02f8a6ab6883 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:28.998950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211631a-cce6-4bc7-866d-0860cda4555b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:28.999386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211631a-cce6-4bc7-866d-0860cda4555b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:28.999483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211631a-cce6-4bc7-866d-0860cda4555b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.001114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 166/319] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:29.006433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b048a-7b84-42af-bae1-569ce3be7782 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.006725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b048a-7b84-42af-bae1-569ce3be7782 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.006999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b048a-7b84-42af-bae1-569ce3be7782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.025993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-046b048a-7b84-42af-bae1-569ce3be7782 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:29.027199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-046b048a-7b84-42af-bae1-569ce3be7782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:29.097777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 154/320] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:29.119824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211631a-cce6-4bc7-866d-0860cda4555b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.124524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1102b-be81-4037-8c28-a220ff12a507 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.124811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1102b-be81-4037-8c28-a220ff12a507 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.125094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1102b-be81-4037-8c28-a220ff12a507 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.126691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 155/321] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:29.131427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c813e-2f49-4a02-b27a-1dc5dd3524c9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.131723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c813e-2f49-4a02-b27a-1dc5dd3524c9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.131997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56c813e-2f49-4a02-b27a-1dc5dd3524c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.151106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b56c813e-2f49-4a02-b27a-1dc5dd3524c9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:29.152315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b56c813e-2f49-4a02-b27a-1dc5dd3524c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:29.211341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:29.218814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 156/322] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:29.220117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51dbb-dba1-45ac-99a9-b1b8616bb2cd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.220406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51dbb-dba1-45ac-99a9-b1b8616bb2cd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.220681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b51dbb-dba1-45ac-99a9-b1b8616bb2cd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.221970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 157/323] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:29.227124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd508-e3f7-4eca-bc1f-052d2fff447d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.227405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd508-e3f7-4eca-bc1f-052d2fff447d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.227677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bd508-e3f7-4eca-bc1f-052d2fff447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.232586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211631a-cce6-4bc7-866d-0860cda4555b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.246201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ae2bd508-e3f7-4eca-bc1f-052d2fff447d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:29.247380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ae2bd508-e3f7-4eca-bc1f-052d2fff447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:29.267776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.268365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.268647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.268919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.270105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:29.271598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:29.272923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:29.273203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 167/324] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:29.278662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.315358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 158/325] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:29.317385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd508-e3f7-4eca-bc1f-052d2fff447d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.375606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352f445-b84c-4dfb-b1f6-84a66a37697f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.407545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.408189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.408464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.409096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.419895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:29.421551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bd508-e3f7-4eca-bc1f-052d2fff447d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:29.425193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:29.426165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:29.427000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 168/326] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:29.427656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.444833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:29.455506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.456139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.456420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.456698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] PATH_INFO: `/v3/groups` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.457363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:29.458884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:29.475339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 159/327] 10.222.0.17 () {60 vars in 1134 bytes} [Sat Aug 6 01:07:29 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:29.476138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.513814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:29.532570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba7874-218f-448f-9dea-4f73842f8dc5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.572372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.573042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.573319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.573593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.585749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:29.591354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:29.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:29.593127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 169/328] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:29.598927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.608981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb6d6aa-9f20-4724-b68c-10e28e983b06 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.645539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.646360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.646564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.646841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.647570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:29.648492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:29.649284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:29.659768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 160/329] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:29.665670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.686611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:29.714966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf656c1c-4138-42e4-ae74-86fea68f9144 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.752619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.753253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.753534 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.753798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.754596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:29.754947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:29.756368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:29.766113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 170/330] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:29.767605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:29.772609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.792073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f61fa-2664-42c9-ba31-89ba7f4844e6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.834898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.835874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.835874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.836091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] PATH_INFO: `/v3/users/c7596896e06d4e07a6d979abbcf9f413` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.837272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] RBAC: Authorizing `identity:get_user(user_id=c7596896e06d4e07a6d979abbcf9f413)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:29.838756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:29.840380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 161/331] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/users/c7596896e06d4e07a6d979abbcf9f413 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:29.846679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.901835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fc03c2-27fa-4081-8921-84026c340e5b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:29.955820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:29.956804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:29.957670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:29.957670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] PATH_INFO: `/v3/users/0fd7ebb240044c549be800968966cf12` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:29.959800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] RBAC: Authorizing `identity:get_user(user_id=0fd7ebb240044c549be800968966cf12)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:29.961298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:29.965801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 171/332] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/users/0fd7ebb240044c549be800968966cf12 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:29.978093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:29.992124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:29.993921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5a417-5cb6-4a12-b7d8-1a7d8245685f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:30.041338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9fcb0-bbaa-498a-9bb9-d17006fd7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:30.042314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9fcb0-bbaa-498a-9bb9-d17006fd7046 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:30.042753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9fcb0-bbaa-498a-9bb9-d17006fd7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:30.043179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9fcb0-bbaa-498a-9bb9-d17006fd7046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:30.044585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9fcb0-bbaa-498a-9bb9-d17006fd7046 None admin] RBAC: Adding query filter params (role.id=96d2ad5552c34a6799019f0c9786745b, user.id=c7596896e06d4e07a6d979abbcf9f413, scope.system=all) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:30.045310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9fcb0-bbaa-498a-9bb9-d17006fd7046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:30.047122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9fcb0-bbaa-498a-9bb9-d17006fd7046 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:30.063026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 162/333] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 01:07:29 2022] GET /identity/v3/role_assignments?user.id=c7596896e06d4e07a6d979abbcf9f413&scope.system=all&role.id=96d2ad5552c34a6799019f0c9786745b => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:30.103296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5b42b-051d-49ae-a247-dad0832d644b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:30.145578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a7814-d80a-492b-ac3c-be4e1ed225ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:30.146686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7814-d80a-492b-ac3c-be4e1ed225ff None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:30.147167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7814-d80a-492b-ac3c-be4e1ed225ff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:30.147661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a7814-d80a-492b-ac3c-be4e1ed225ff None admin] PATH_INFO: `/v3/system/users/0fd7ebb240044c549be800968966cf12/roles/c504cf6f193e4ddba25a02f8a6ab6883` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:30.149401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7814-d80a-492b-ac3c-be4e1ed225ff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0fd7ebb240044c549be800968966cf12, role_id=c504cf6f193e4ddba25a02f8a6ab6883)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:30.151054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a7814-d80a-492b-ac3c-be4e1ed225ff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:30.169727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 172/334] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Aug 6 01:07:29 2022] PUT /identity/v3/system/users/0fd7ebb240044c549be800968966cf12/roles/c504cf6f193e4ddba25a02f8a6ab6883 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:31.797030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8bfd4-5b25-4ff3-9c38-b6a145fafd85 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:31.797529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8bfd4-5b25-4ff3-9c38-b6a145fafd85 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:31.797529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed8bfd4-5b25-4ff3-9c38-b6a145fafd85 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:31.799171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 163/335] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:31.804658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e831981-14e4-4d35-bb04-cee4cda2fed3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:31.805474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e831981-14e4-4d35-bb04-cee4cda2fed3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:31.805979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e831981-14e4-4d35-bb04-cee4cda2fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:31.831413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0e831981-14e4-4d35-bb04-cee4cda2fed3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:31.833010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e831981-14e4-4d35-bb04-cee4cda2fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:31.915713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:31.922353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 173/336] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:31.953671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8bfd4-5b25-4ff3-9c38-b6a145fafd85 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:31.971085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:32.108680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed8bfd4-5b25-4ff3-9c38-b6a145fafd85 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:32.143222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:32.143873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.144149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.144416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.161047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:32.165982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:32.166899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:32.167686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:32.169756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 164/337] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:32.174812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e831981-14e4-4d35-bb04-cee4cda2fed3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:32.332473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e831981-14e4-4d35-bb04-cee4cda2fed3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:32.370689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715efaf-aaf1-43da-8758-fec123c8a11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:32.371627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715efaf-aaf1-43da-8758-fec123c8a11d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.372099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715efaf-aaf1-43da-8758-fec123c8a11d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.372541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715efaf-aaf1-43da-8758-fec123c8a11d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.373444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715efaf-aaf1-43da-8758-fec123c8a11d None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:32.373919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715efaf-aaf1-43da-8758-fec123c8a11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:32.375557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715efaf-aaf1-43da-8758-fec123c8a11d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:32.385165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 174/338] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:32.395069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:32.483371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2475a-a8a6-4f1d-aaa5-da0542cd0b59 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.484011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2475a-a8a6-4f1d-aaa5-da0542cd0b59 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.484483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2475a-a8a6-4f1d-aaa5-da0542cd0b59 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.486345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 175/339] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:32.492086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5ee0a-d4d6-4449-a2b8-35717c60c476 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.492603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5ee0a-d4d6-4449-a2b8-35717c60c476 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.493085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5ee0a-d4d6-4449-a2b8-35717c60c476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.527151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-90e5ee0a-d4d6-4449-a2b8-35717c60c476 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:32.528708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-90e5ee0a-d4d6-4449-a2b8-35717c60c476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:32.560019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:32.608886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:32.625627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470749-2df5-4ee2-96fb-4530dd63724c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:32.627544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 176/340] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:32.657601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3fc82-20d5-4ccd-9ebc-3c203692e563 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.658266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3fc82-20d5-4ccd-9ebc-3c203692e563 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.659075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3fc82-20d5-4ccd-9ebc-3c203692e563 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.660949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 177/341] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:32.666672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985441-dd9e-4269-8bf7-87a68e5a3c06 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.667287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985441-dd9e-4269-8bf7-87a68e5a3c06 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.667757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985441-dd9e-4269-8bf7-87a68e5a3c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.680006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:32.680650 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.680933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.681258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.690222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7d985441-dd9e-4269-8bf7-87a68e5a3c06 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:32.691744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7d985441-dd9e-4269-8bf7-87a68e5a3c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:32.768020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:32.769384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 178/342] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:32.769565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:32.770641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985441-dd9e-4269-8bf7-87a68e5a3c06 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:32.846105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:32.886170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 165/343] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:32.887343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:32.893587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985441-dd9e-4269-8bf7-87a68e5a3c06 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:32.917774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:32.930151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:32.931124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:32.931599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:32.932062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:32.942845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:32.948092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:32.948979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:32.949793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:32.952448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 179/344] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:32.953422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.003418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd531290-730f-4109-8466-03683ccb2038 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.045092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.046023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.046445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.046854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.058795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:33.060413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6680-0c58-4ede-88d5-70b3339e9ddf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:33.064530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:33.065493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:33.066357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:33.068551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 166/345] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:33.069488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.097633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cb473-93eb-4ed2-bda2-e89dc98ef380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.098726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cb473-93eb-4ed2-bda2-e89dc98ef380 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.099147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cb473-93eb-4ed2-bda2-e89dc98ef380 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.099556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cb473-93eb-4ed2-bda2-e89dc98ef380 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.100886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cb473-93eb-4ed2-bda2-e89dc98ef380 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:33.102546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cb473-93eb-4ed2-bda2-e89dc98ef380 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:33.103028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.104866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 180/346] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:32 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:33.106229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7ece-6ce5-4a83-97b6-0660430d745e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.106655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7ece-6ce5-4a83-97b6-0660430d745e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.107062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc7ece-6ce5-4a83-97b6-0660430d745e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.108687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 181/347] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:33.109586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7ece-6ce5-4a83-97b6-0660430d745e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.162585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.193534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea91cbe-31cd-438c-8a0f-f11be6198220 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.217117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc7ece-6ce5-4a83-97b6-0660430d745e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.232261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bd50b-e02f-4d33-b8aa-e4918866f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.233190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bd50b-e02f-4d33-b8aa-e4918866f10d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.233640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bd50b-e02f-4d33-b8aa-e4918866f10d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.234106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bd50b-e02f-4d33-b8aa-e4918866f10d None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.234980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bd50b-e02f-4d33-b8aa-e4918866f10d None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:33.235427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bd50b-e02f-4d33-b8aa-e4918866f10d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:33.237140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bd50b-e02f-4d33-b8aa-e4918866f10d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:33.247268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 167/348] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:33.248966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277323f-d179-443a-8b99-81f81f0836d7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.249400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277323f-d179-443a-8b99-81f81f0836d7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.249817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277323f-d179-443a-8b99-81f81f0836d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.259946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.260843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.261263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.261673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.262578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:33.263023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:33.264576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:33.268675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c277323f-d179-443a-8b99-81f81f0836d7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:33.270024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c277323f-d179-443a-8b99-81f81f0836d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:33.274715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 182/349] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:33.275723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.347646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 168/350] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:33.348746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277323f-d179-443a-8b99-81f81f0836d7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.376325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.379369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566f2c-f96c-44f9-a843-6443c9013a89 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.394470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.416560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.417449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.417868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.418329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.424652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:33.426329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:33.428491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 183/351] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:33.429403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.468542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277323f-d179-443a-8b99-81f81f0836d7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.512588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.513238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.513531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.513810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.560040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea67a2e-344b-4623-95fb-81c71dafb63a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.607629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:33.609383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:33.612601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.613498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.613865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.614205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.637076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.676553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.708653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:33.710575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:33.735311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 169/352] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:33.736394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.829411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 184/353] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:33.831345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:33.881273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16773fe0-cde7-47ab-844b-d8c36261f31f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.914759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.929519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:33.932833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:33.933614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:33.933912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:33.934212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:33.953140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:33.958547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:33.959421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 06 01:07:33.960228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:33.960854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18b0ba-46bc-4fb1-8931-fa76b0b7fced None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:33.962515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 170/354] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:33.963465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.003551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681b7d0-3fef-4f0e-b95e-d25746ff1e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.004184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b7d0-3fef-4f0e-b95e-d25746ff1e20 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.004500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b7d0-3fef-4f0e-b95e-d25746ff1e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.004798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681b7d0-3fef-4f0e-b95e-d25746ff1e20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.005598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681b7d0-3fef-4f0e-b95e-d25746ff1e20 None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=09a78bed4fac444bba365f738da8e411) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:34.005922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681b7d0-3fef-4f0e-b95e-d25746ff1e20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.007414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681b7d0-3fef-4f0e-b95e-d25746ff1e20 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.015025 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 185/355] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=96d2ad5552c34a6799019f0c9786745b => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.015422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211f4d-4fc8-4d32-989f-c2385ea0a2b1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.015720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211f4d-4fc8-4d32-989f-c2385ea0a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.016055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f211f4d-4fc8-4d32-989f-c2385ea0a2b1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.017422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 186/356] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:34.022412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211f4d-4fc8-4d32-989f-c2385ea0a2b1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.104654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6fcd2-f251-4e46-9b7e-b80be05a4fcd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.147387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.148121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.148390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.148661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.149913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.151459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.153449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 171/357] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:33 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.154116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.180923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f211f4d-4fc8-4d32-989f-c2385ea0a2b1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.213958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:34.229472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899ef85-e40d-4c45-b762-60932180d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.230183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ef85-e40d-4c45-b762-60932180d403 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.230464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ef85-e40d-4c45-b762-60932180d403 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.230734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899ef85-e40d-4c45-b762-60932180d403 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.232109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ef85-e40d-4c45-b762-60932180d403 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.233584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899ef85-e40d-4c45-b762-60932180d403 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.235258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 187/358] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.236542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b589f7-0f73-4341-9f5b-7f5c0721b8b2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.236775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b589f7-0f73-4341-9f5b-7f5c0721b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.237050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b589f7-0f73-4341-9f5b-7f5c0721b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.257649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d5b589f7-0f73-4341-9f5b-7f5c0721b8b2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:34.258933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d5b589f7-0f73-4341-9f5b-7f5c0721b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:34.262763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:34.282354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f16200-1981-454b-8371-a3f3079cc55c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.323164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.323917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.324209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.324474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.325225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:34.325523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.327015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.336180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 172/359] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.337012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.348006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 188/360] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:34.351294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b204ec-b936-4afd-b7b1-64a835f56c6b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.351625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b204ec-b936-4afd-b7b1-64a835f56c6b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.351953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b204ec-b936-4afd-b7b1-64a835f56c6b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.353408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 189/361] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:34.355400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b204ec-b936-4afd-b7b1-64a835f56c6b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.477762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a9e94-1c79-4514-a6b4-796f716f87bf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.492702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:34.494921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b204ec-b936-4afd-b7b1-64a835f56c6b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.527623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.528048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.528324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.528594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.531376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.533700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.536220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 173/362] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.537373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.538321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ca586-1ecd-45d1-b11f-54e51ba01735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.538978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ca586-1ecd-45d1-b11f-54e51ba01735 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.539264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ca586-1ecd-45d1-b11f-54e51ba01735 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.539542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ca586-1ecd-45d1-b11f-54e51ba01735 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.540947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ca586-1ecd-45d1-b11f-54e51ba01735 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.542470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ca586-1ecd-45d1-b11f-54e51ba01735 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.544187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 190/363] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.545349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463acbc-b73c-4736-8f4f-a4145e377f56 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.545629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463acbc-b73c-4736-8f4f-a4145e377f56 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.545899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463acbc-b73c-4736-8f4f-a4145e377f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.564507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:34.571805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f463acbc-b73c-4736-8f4f-a4145e377f56 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:34.573016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f463acbc-b73c-4736-8f4f-a4145e377f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:34.655796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d599b-3a70-43ff-accb-80b28de4f062 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.662615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 191/364] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:34.663305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463acbc-b73c-4736-8f4f-a4145e377f56 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.712656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.713383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.713661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.714062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] PATH_INFO: `/v3/users/0fd7ebb240044c549be800968966cf12` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.715269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] RBAC: Authorizing `identity:get_user(user_id=0fd7ebb240044c549be800968966cf12)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.716734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.718416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 174/365] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/users/0fd7ebb240044c549be800968966cf12 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.719253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.772197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:34.777805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463acbc-b73c-4736-8f4f-a4145e377f56 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.826220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.826886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.827169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.827443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.831157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:34.841460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:34.846597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:34.847715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:34.848785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:34.849799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f9529-eaee-462e-b71e-6810dd3e58b1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:34.849952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 192/366] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:34.850746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.894149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:34.896171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:34.896171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:34.896171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:34.896593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=f47d375130964aa590995b8d7151684a) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:34.896904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:34.898780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:34.905760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 175/367] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=96d2ad5552c34a6799019f0c9786745b => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:34.907378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:34.979036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81606d61-2065-4146-984a-e58999064bc7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.018638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.019358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.019646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.019917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.021275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=09a78bed4fac444bba365f738da8e411) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:35.021275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:35.022748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:35.029223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 193/368] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:35.034324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:35.045669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060c052-aa48-49ff-9cfb-17eea75c8db6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.062253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:35.089094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.089863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.090235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.090624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.104087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:35.109796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:35.110810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:35.111584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:35.118290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 176/369] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:35.118616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:35.129729 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:35.220064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628ba13-bfee-4e44-9c07-cacb4902b131 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.240081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4bda1-3e44-431e-8385-8c596000f095 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.284196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.284820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.285182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.285524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.286844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:35.287404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:35.288962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:35.300841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 177/370] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:35.304103 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.304957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:35.305182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.305671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.306229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.307234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] RBAC: Adding query filter params (role.id=c504cf6f193e4ddba25a02f8a6ab6883, user.id=0fd7ebb240044c549be800968966cf12, scope.system=all) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:35.307746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:35.309613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:35.328731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 194/371] 10.222.0.17 () {56 vars in 1308 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/role_assignments?user.id=0fd7ebb240044c549be800968966cf12&scope.system=all&role.id=c504cf6f193e4ddba25a02f8a6ab6883 => generated 510 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:35.329916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:35.349121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:35.431027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224717f-17c6-4fec-99c1-de7d2a67151e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.470903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8176375-5830-4bd6-a51f-b615d289641c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.475533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.476377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.476794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.477203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.478093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:35.478535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:35.480599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:35.498290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 178/372] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:35.505332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:35.507028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:35.527760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.528602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.528956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.529302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.624019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:35.625465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:35.646232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:35.654312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceca4e-ec31-4699-b7a0-e7843c936b27 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.699526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.700167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.700447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.700717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.738403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 195/373] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:35.744832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:35.765553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:35.785201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:35.788296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:35.854551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ca4c8-af82-4966-97e4-f95901bced67 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:35.890811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:35.891422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:35.891769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:35.892109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:35.893349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:35.894935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:35.896830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 196/374] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:35.899153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:35.903012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:35.909703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 179/375] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:07:35.915915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:36.032202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:36.048954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ded77-d63b-4d0c-9c50-7701f5bc0ad2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:36.055124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67c95b-0f9e-408c-92c5-3a19bd322eba None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:36.085469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:36.086163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:36.086443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:36.086722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:36.087964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:36.089535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:36.091510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 197/376] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:36.096451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:36.097303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:36.098819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:36.099098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:36.099370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] PATH_INFO: `/v3/projects/d85d95c8bfc045dbb053756109fbe722` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:36.102734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] RBAC: Authorizing `identity:get_project(project_id=d85d95c8bfc045dbb053756109fbe722)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:36.104211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:36.110488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 180/377] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:35 2022] GET /identity/v3/projects/d85d95c8bfc045dbb053756109fbe722 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:36.111689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:36.209552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:36.213871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84c4e-6f21-4a74-9ff4-09f9ba2891e4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:36.251427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:36.252108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:36.252432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:36.252715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:36.253517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=f47d375130964aa590995b8d7151684a) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:36.253834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:36.255472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:36.262005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 198/378] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:36 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:36.326418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0be14-0e72-4193-90b7-811bcc8205c4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:36.373373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836bf00-450f-4163-8b77-a2e7545900ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:36.374123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836bf00-450f-4163-8b77-a2e7545900ae None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:36.374403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836bf00-450f-4163-8b77-a2e7545900ae None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:36.374723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836bf00-450f-4163-8b77-a2e7545900ae None admin] PATH_INFO: `/v3/groups/86edb48a955f4d1d9b746c4c0d43cf1c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:36.387691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836bf00-450f-4163-8b77-a2e7545900ae None admin] RBAC: Authorizing `identity:get_group(group_id=86edb48a955f4d1d9b746c4c0d43cf1c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:36.389250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836bf00-450f-4163-8b77-a2e7545900ae None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:36.391401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 181/379] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:36 2022] GET /identity/v3/groups/86edb48a955f4d1d9b746c4c0d43cf1c => generated 229 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:36.397559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:36.429039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:36.531948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c676b33-1b20-48cc-9653-f003e84e457f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:36.566495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecf4d5-169d-4753-aa2d-ee30094486ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:36.567171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf4d5-169d-4753-aa2d-ee30094486ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:36.567455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf4d5-169d-4753-aa2d-ee30094486ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:36.567732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf4d5-169d-4753-aa2d-ee30094486ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:36.568535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecf4d5-169d-4753-aa2d-ee30094486ec None admin] RBAC: Adding query filter params (group.id=86edb48a955f4d1d9b746c4c0d43cf1c, role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=d85d95c8bfc045dbb053756109fbe722) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:36.568848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecf4d5-169d-4753-aa2d-ee30094486ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:36.570359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecf4d5-169d-4753-aa2d-ee30094486ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:36.576083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 199/380] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:36 2022] GET /identity/v3/role_assignments?group.id=86edb48a955f4d1d9b746c4c0d43cf1c&scope.project.id=d85d95c8bfc045dbb053756109fbe722&role.id=1aa37aeab6694470b737775bf433503d => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:36.774465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96467e-fe75-46a0-8578-201f10956f38 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:36.774820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96467e-fe75-46a0-8578-201f10956f38 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:36.774990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96467e-fe75-46a0-8578-201f10956f38 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:36.776636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 182/381] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:36.782006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073c5c6-169d-4501-9ee0-6d74893ba30e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:36.782301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073c5c6-169d-4501-9ee0-6d74893ba30e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:36.782584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073c5c6-169d-4501-9ee0-6d74893ba30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:36.804644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7073c5c6-169d-4501-9ee0-6d74893ba30e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:36.805854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7073c5c6-169d-4501-9ee0-6d74893ba30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:36.897526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 200/382] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:36.929837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96467e-fe75-46a0-8578-201f10956f38 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:37.075323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96467e-fe75-46a0-8578-201f10956f38 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:37.107363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:37.117970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:37.119124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:37.119673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:37.120336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:37.132071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:37.137024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:37.137897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:37.138729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 183/383] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:37.144493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073c5c6-169d-4501-9ee0-6d74893ba30e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:37.159605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:37.273145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073c5c6-169d-4501-9ee0-6d74893ba30e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:37.313963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:37.315034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:37.315517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:37.316016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:37.316988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:37.317516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:37.319181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:37.334015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 201/384] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:37.340462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:37.464914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f17e1b6-5e12-4e24-8f49-fe4f7fdeeb4e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:37.509048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:37.509759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:37.510069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:37.510339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:37.511511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:37.513020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:37.515014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 184/385] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:37 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:37.520693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:37.634365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:37.660209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca30bdc-5ef7-4b7e-a445-5e0c90e7c6a6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:37.699355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d3fd7-87cf-4cb6-9794-70b313dd81b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:37.700026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3fd7-87cf-4cb6-9794-70b313dd81b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:37.700308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3fd7-87cf-4cb6-9794-70b313dd81b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:37.700586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d3fd7-87cf-4cb6-9794-70b313dd81b1 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:37.701777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d3fd7-87cf-4cb6-9794-70b313dd81b1 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:37.703288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d3fd7-87cf-4cb6-9794-70b313dd81b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:37.705289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 202/386] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:37 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:37.711045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:37.731338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db9ea-3382-47a0-bd00-6f74ce926b08 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:37.731645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db9ea-3382-47a0-bd00-6f74ce926b08 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:37.731897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8db9ea-3382-47a0-bd00-6f74ce926b08 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:37.733274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 203/387] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:37.738241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8ec1-cdf1-46a9-85aa-d56c134017a4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:37.738526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8ec1-cdf1-46a9-85aa-d56c134017a4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:37.738847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8ec1-cdf1-46a9-85aa-d56c134017a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:37.761841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-949a8ec1-cdf1-46a9-85aa-d56c134017a4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:37.763088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-949a8ec1-cdf1-46a9-85aa-d56c134017a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:37.801462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:37.883229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 204/388] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:37.889618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f709353-a8d6-47e1-aa0a-9bd21502c9b1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:37.906616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8ec1-cdf1-46a9-85aa-d56c134017a4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:37.957030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20e64d-9522-44b2-8325-784776cf6fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:37.957835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20e64d-9522-44b2-8325-784776cf6fca None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:37.958120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20e64d-9522-44b2-8325-784776cf6fca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:37.958433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20e64d-9522-44b2-8325-784776cf6fca None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411/groups/4933776467404e578553e626287853ce/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:37.960405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20e64d-9522-44b2-8325-784776cf6fca None admin] RBAC: Authorizing `identity:create_grant(project_id=09a78bed4fac444bba365f738da8e411, group_id=4933776467404e578553e626287853ce, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:37.961876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20e64d-9522-44b2-8325-784776cf6fca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:38.000238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 185/389] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 01:07:37 2022] PUT /identity/v3/projects/09a78bed4fac444bba365f738da8e411/groups/4933776467404e578553e626287853ce/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:38.001797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:38.046255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8ec1-cdf1-46a9-85aa-d56c134017a4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:38.081337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb7fe3-6263-4973-bc08-11cf5ad6f659 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.082029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb7fe3-6263-4973-bc08-11cf5ad6f659 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.082758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb7fe3-6263-4973-bc08-11cf5ad6f659 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.086043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 186/390] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:38.091442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4801-4bc7-4f3b-96c3-a3f98b6b2107 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.091948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4801-4bc7-4f3b-96c3-a3f98b6b2107 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.092408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a4801-4bc7-4f3b-96c3-a3f98b6b2107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.094150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:38.094828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.095107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.095431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.112879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:38.124116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:38.125087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:38.125887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:38.127362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 205/391] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:38.134216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:38.136776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f72a4801-4bc7-4f3b-96c3-a3f98b6b2107 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:38.140354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f72a4801-4bc7-4f3b-96c3-a3f98b6b2107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:38.276982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b17ba-7114-441a-ba89-b7b2c300f456 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:38.320068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 187/392] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:38.323076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:38.335171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:38.336120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.336587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.337054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.338015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:38.338516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:38.340152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:38.351201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 206/393] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:38.351397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4801-4bc7-4f3b-96c3-a3f98b6b2107 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:38.358948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:38.464562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394a694-d701-4dcd-9189-dd86d05aae5a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:38.480738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:38.504135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:38.504875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.505155 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.505432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.506817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:38.508324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:38.510027 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 207/394] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:38 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:38.518957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:38.589115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:38.597700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a4801-4bc7-4f3b-96c3-a3f98b6b2107 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:38.628988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5684ab-c976-43e6-9f19-218d4a9f7576 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:38.671460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:38.672548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.673102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.673569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.690129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:38.690796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.691086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.691357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.692627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:38.697922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:38.697922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:38.698138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:38.699436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:38.700523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 188/395] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:38.701706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 208/396] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:38 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:38.704751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:38.705819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:38.879038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047442b2-1351-4896-bdef-efa518dc01e3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:38.916778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed626-52f8-42eb-8444-a6d63bc11537 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:38.925536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:38.930904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:38.946011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37200c71-e823-4f5f-bf73-1a6b25da7a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:38.946920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200c71-e823-4f5f-bf73-1a6b25da7a7e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.947201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200c71-e823-4f5f-bf73-1a6b25da7a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.947471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200c71-e823-4f5f-bf73-1a6b25da7a7e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.948834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37200c71-e823-4f5f-bf73-1a6b25da7a7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:38.949154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37200c71-e823-4f5f-bf73-1a6b25da7a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:38.951104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37200c71-e823-4f5f-bf73-1a6b25da7a7e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:38.961611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f08c9b-efa3-4a65-8065-546cdfe50eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:38.962207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 209/397] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:38.963335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5178c5b-f188-43bb-9d7b-3272af3b6e9b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.963619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5178c5b-f188-43bb-9d7b-3272af3b6e9b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.963893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5178c5b-f188-43bb-9d7b-3272af3b6e9b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.965102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 210/398] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:38.966396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08c9b-efa3-4a65-8065-546cdfe50eeb None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.966687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08c9b-efa3-4a65-8065-546cdfe50eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.966971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f08c9b-efa3-4a65-8065-546cdfe50eeb None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a/groups/4933776467404e578553e626287853ce/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:38.969234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5178c5b-f188-43bb-9d7b-3272af3b6e9b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:38.971407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f08c9b-efa3-4a65-8065-546cdfe50eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=f47d375130964aa590995b8d7151684a, group_id=4933776467404e578553e626287853ce, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:38.974521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f08c9b-efa3-4a65-8065-546cdfe50eeb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:38.996117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 189/399] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 01:07:38 2022] PUT /identity/v3/projects/f47d375130964aa590995b8d7151684a/groups/4933776467404e578553e626287853ce/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:38.997513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd973aa-d517-4e64-899b-61419dbaf52f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:38.998200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd973aa-d517-4e64-899b-61419dbaf52f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:38.998418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd973aa-d517-4e64-899b-61419dbaf52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.026819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5fd973aa-d517-4e64-899b-61419dbaf52f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:39.028562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5fd973aa-d517-4e64-899b-61419dbaf52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:39.093206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5178c5b-f188-43bb-9d7b-3272af3b6e9b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:39.107496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 190/400] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:39.134749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd973aa-d517-4e64-899b-61419dbaf52f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:39.136241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:39.137218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.137502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.138829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.140372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:39.141885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:39.144528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 211/401] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:38 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:39.150128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:39.214064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:39.259240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:39.267259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd973aa-d517-4e64-899b-61419dbaf52f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:39.270981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec8b21-26e0-4f56-a73f-4a70f9749c52 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:39.317298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:39.318106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.318313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.318890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.320076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:39.320297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:39.320739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.321005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.321276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.321827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:39.323800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 212/402] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:39 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:39.329548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:39.335198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:39.340519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:39.341423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:39.342261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:39.344750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 191/403] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:39.359197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:39.437909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a7f5-09e7-4ffa-a4ab-1eab2f19e698 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:39.482962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:39.499328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4d22b-8754-47af-aa78-90085ffb3f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:39.502846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4d22b-8754-47af-aa78-90085ffb3f76 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.502846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4d22b-8754-47af-aa78-90085ffb3f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.502846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4d22b-8754-47af-aa78-90085ffb3f76 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411/groups/4933776467404e578553e626287853ce/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.503300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4d22b-8754-47af-aa78-90085ffb3f76 None admin] RBAC: Authorizing `identity:create_grant(project_id=09a78bed4fac444bba365f738da8e411, group_id=4933776467404e578553e626287853ce, role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:39.505087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac4d22b-8754-47af-aa78-90085ffb3f76 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:39.524232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 213/404] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 01:07:39 2022] PUT /identity/v3/projects/09a78bed4fac444bba365f738da8e411/groups/4933776467404e578553e626287853ce/roles/063bbdfce3224ede93cacead71ab0bfa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:07:39.529974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f794159-a18a-4db8-ac74-efcb832b5dc0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.529974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f794159-a18a-4db8-ac74-efcb832b5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.529974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f794159-a18a-4db8-ac74-efcb832b5dc0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.529974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 214/405] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:39.535226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0f30f-e694-4a87-a7e2-06539a946a5b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.535828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0f30f-e694-4a87-a7e2-06539a946a5b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.536412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0f30f-e694-4a87-a7e2-06539a946a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.542304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b51197-d321-4a12-977f-0adce44b87ca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:39.580739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-68e0f30f-e694-4a87-a7e2-06539a946a5b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:39.585032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-68e0f30f-e694-4a87-a7e2-06539a946a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:39.624208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:39.624865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.625197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.625468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.626237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:39.626541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:39.631621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:39.653353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 192/406] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:39.657592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:39.711225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:39.715702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 215/407] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:39.745883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0f30f-e694-4a87-a7e2-06539a946a5b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:39.805039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d84ce2-c8f9-4bdd-bffd-e3678899ec67 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:39.858581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:39.859237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.859516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.859783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.860935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:39.862424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:39.864699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 193/408] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:39 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:39.871081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:39.904278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0f30f-e694-4a87-a7e2-06539a946a5b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:39.934291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:39.968108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:39.969392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:39.970288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:39.971035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:39.985620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:39.993115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:39.994055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:39.994847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:39.996172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 216/409] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:39.996668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:40.006926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:40.033711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2d341-bf24-4326-a97b-08c5767f51d5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:40.097203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:40.097866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.098300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.098580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.101237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:40.102762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:40.104482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 194/410] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:39 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:40.114611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:40.180834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cddc0-80bc-421e-a6f9-8683f6583ae3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:40.225164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6edb8cc-f8e1-40a1-a6fa-a9da0c65bf64 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:40.259802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:40.260501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.260773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.261041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a/groups/4933776467404e578553e626287853ce/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.263407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] RBAC: Authorizing `identity:create_grant(project_id=f47d375130964aa590995b8d7151684a, group_id=4933776467404e578553e626287853ce, role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:40.264871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:40.275293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dc90e-2b1c-4efc-9d0b-c0662e344f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:40.276387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dc90e-2b1c-4efc-9d0b-c0662e344f02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.276881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dc90e-2b1c-4efc-9d0b-c0662e344f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.277352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dc90e-2b1c-4efc-9d0b-c0662e344f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.278327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dc90e-2b1c-4efc-9d0b-c0662e344f02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:40.278827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dc90e-2b1c-4efc-9d0b-c0662e344f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:40.278941 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 195/411] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 01:07:40 2022] PUT /identity/v3/projects/f47d375130964aa590995b8d7151684a/groups/4933776467404e578553e626287853ce/roles/063bbdfce3224ede93cacead71ab0bfa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:40.280976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dc90e-2b1c-4efc-9d0b-c0662e344f02 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:40.305802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 217/412] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:40.311773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:40.358055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:40.460989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344e7ce-2663-4be6-948a-d27f6b7a4e89 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:40.461830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd1d7-eb56-474c-be4b-d3ea4fd9556a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.462287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd1d7-eb56-474c-be4b-d3ea4fd9556a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.462446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8cd1d7-eb56-474c-be4b-d3ea4fd9556a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.464031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 218/413] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:40.469030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6adf6-7789-4de2-b064-70583d758e28 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.469311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6adf6-7789-4de2-b064-70583d758e28 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.469584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6adf6-7789-4de2-b064-70583d758e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.488867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dda6adf6-7789-4de2-b064-70583d758e28 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:40.489867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dda6adf6-7789-4de2-b064-70583d758e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:40.500044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:40.501056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.501539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.502034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] PATH_INFO: `/v3/groups/86edb48a955f4d1d9b746c4c0d43cf1c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.503436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] RBAC: Authorizing `identity:get_group(group_id=86edb48a955f4d1d9b746c4c0d43cf1c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:40.505205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:40.507634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 196/414] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:40 2022] GET /identity/v3/groups/86edb48a955f4d1d9b746c4c0d43cf1c => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:40.512736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:40.540319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:40.578866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 219/415] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:40.599178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:40.604204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6adf6-7789-4de2-b064-70583d758e28 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:40.619407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e129059-0596-46a0-8c8b-63958c989ef7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:40.655200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:40.655856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.656134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.656398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] PATH_INFO: `/v3/projects/d85d95c8bfc045dbb053756109fbe722` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.657557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] RBAC: Authorizing `identity:get_project(project_id=d85d95c8bfc045dbb053756109fbe722)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:40.659894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:40.666047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 197/416] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:40 2022] GET /identity/v3/projects/d85d95c8bfc045dbb053756109fbe722 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:40.667676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:40.787338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6adf6-7789-4de2-b064-70583d758e28 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:40.792106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48b776-1452-47b0-96ca-575751a38a78 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:40.827238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:40.827899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.828176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.828446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.841300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:40.847165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:40.848125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:40.848893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 220/417] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:40.855880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:40.866063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:40.866767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:40.867052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:40.867330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] PATH_INFO: `/v3/projects/d85d95c8bfc045dbb053756109fbe722/groups/86edb48a955f4d1d9b746c4c0d43cf1c/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:40.877155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] RBAC: Authorizing `identity:create_grant(project_id=d85d95c8bfc045dbb053756109fbe722, group_id=86edb48a955f4d1d9b746c4c0d43cf1c, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:40.878689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:40.893690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:40.902626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 198/418] 10.222.0.17 () {58 vars in 1442 bytes} [Sat Aug 6 01:07:40 2022] PUT /identity/v3/projects/d85d95c8bfc045dbb053756109fbe722/groups/86edb48a955f4d1d9b746c4c0d43cf1c/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:41.004046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787f5a3-0ad5-4f67-a07a-f58eea59915a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:41.051279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:41.051837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.052116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.052387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.053126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:41.053431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:41.054954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:41.065901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 221/419] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:41.071991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:41.085811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:41.182247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc15bca-3c02-4379-afd9-bfc8cf179dcc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:41.218780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:41.219415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.219694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.220029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.294774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:41.296257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:41.308938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:41.406797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 199/420] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:41.412648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:41.545433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:41.556218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63cf4b-0a27-4e79-9cfb-b470099498f0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:41.595928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f807d7ab-3601-4edb-b668-9e61bf705f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:41.596553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d7ab-3601-4edb-b668-9e61bf705f71 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.596881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d7ab-3601-4edb-b668-9e61bf705f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.597156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f807d7ab-3601-4edb-b668-9e61bf705f71 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.598438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807d7ab-3601-4edb-b668-9e61bf705f71 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:41.600016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f807d7ab-3601-4edb-b668-9e61bf705f71 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:41.602057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 222/421] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:41 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:41.611214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:41.736516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff68c9-0a6a-4dc3-b9fd-e76e1f360697 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:41.750340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:41.750521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c1a00-07db-4a19-b4f0-78e0b64fc432 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.750521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c1a00-07db-4a19-b4f0-78e0b64fc432 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.750521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c1a00-07db-4a19-b4f0-78e0b64fc432 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.751570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 223/422] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:41.757756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7804b-4ab7-4c93-a6a2-48cc7ac2b447 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.758418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7804b-4ab7-4c93-a6a2-48cc7ac2b447 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.759059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7804b-4ab7-4c93-a6a2-48cc7ac2b447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.773139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:41.773801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.774380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.774380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.775509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:41.776957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:41.780194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dbc7804b-4ab7-4c93-a6a2-48cc7ac2b447 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:41.781610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dbc7804b-4ab7-4c93-a6a2-48cc7ac2b447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:41.783792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 200/423] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:41 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:41.784981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:41.856592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 224/424] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:41.866364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b538f1-5819-469a-9119-e4f0566a4a72 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.866934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b538f1-5819-469a-9119-e4f0566a4a72 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.867397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b538f1-5819-469a-9119-e4f0566a4a72 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.869492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 225/425] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:41 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:41.874446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674f1f-55ac-42d2-a2ce-049bbfa9b17c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.874943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674f1f-55ac-42d2-a2ce-049bbfa9b17c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.875423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52674f1f-55ac-42d2-a2ce-049bbfa9b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.903664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-52674f1f-55ac-42d2-a2ce-049bbfa9b17c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:41.905214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52674f1f-55ac-42d2-a2ce-049bbfa9b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:41.906819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a642d7-b0d8-468f-8793-295c89a92719 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:41.951337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:41.952395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:41.952686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:41.952951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:41.953747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=09a78bed4fac444bba365f738da8e411) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:41.954090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:41.956237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:41.966016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 201/426] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:41 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=96d2ad5552c34a6799019f0c9786745b => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:41.967139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:41.996841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 226/427] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:42.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.032159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674f1f-55ac-42d2-a2ce-049bbfa9b17c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:42.061917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.151663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0d44-2a4a-4780-90ed-8847bcd84fbd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:42.206985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:42.208048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.208587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.209062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.209994 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52674f1f-55ac-42d2-a2ce-049bbfa9b17c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:42.221834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:42.228005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:42.228973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 06 01:07:42.229764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:42.232548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 202/428] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:42.238766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:42.246550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:42.247203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.247478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.247749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.259125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:42.264040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:42.264925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:42.265826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 227/429] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:42.271271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:42.375820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba7c7-d8ee-4a28-80b0-1d3e80984947 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:42.379279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.391065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.424069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83710405-f1f5-45f4-a563-6fd555e4b519 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:42.428938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:42.429656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.430039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.430381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.431172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:42.431542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:42.432940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:42.449475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 203/430] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:07:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:42.450861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:42.467315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:42.467924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.468201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.468472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.469192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:42.469495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:42.473207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:42.482268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 228/431] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:42.488079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:42.603058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7d9bd-62ed-4e60-9f0c-4a27252317fa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:42.610567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaaed35-2a26-4f13-aae9-528b14cb28dc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:42.652326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b8f4-3f72-4271-aef8-1dd7bd806021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:42.652718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505dabe-b580-4e23-8364-d9f629f9e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:42.653361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505dabe-b580-4e23-8364-d9f629f9e0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.653689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505dabe-b580-4e23-8364-d9f629f9e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.653976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b8f4-3f72-4271-aef8-1dd7bd806021 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.654077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505dabe-b580-4e23-8364-d9f629f9e0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.654605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b8f4-3f72-4271-aef8-1dd7bd806021 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.655196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b8f4-3f72-4271-aef8-1dd7bd806021 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.669398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.696162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.739772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505dabe-b580-4e23-8364-d9f629f9e0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:42.742429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505dabe-b580-4e23-8364-d9f629f9e0c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:42.743706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b8f4-3f72-4271-aef8-1dd7bd806021 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:42.745500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b8f4-3f72-4271-aef8-1dd7bd806021 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:42.859712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 204/432] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:07:42.861259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ba342-05f4-486b-9b6c-239cee319aa4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.861506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ba342-05f4-486b-9b6c-239cee319aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.861714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ba342-05f4-486b-9b6c-239cee319aa4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.863277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 205/433] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:42.864357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 229/434] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:42.866890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ba342-05f4-486b-9b6c-239cee319aa4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:42.871037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d831-392c-48f1-8684-74c9185eb5a2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:42.871522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d831-392c-48f1-8684-74c9185eb5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:42.871960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3d831-392c-48f1-8684-74c9185eb5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:42.891175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-abe3d831-392c-48f1-8684-74c9185eb5a2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:42.892523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-abe3d831-392c-48f1-8684-74c9185eb5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:42.935386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.943263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:42.974159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 230/435] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:42.975304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d831-392c-48f1-8684-74c9185eb5a2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:42.995517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ba342-05f4-486b-9b6c-239cee319aa4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.036880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.038453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.038879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.039519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.041431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.043094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.045435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 206/436] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:42 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:43.046400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.083547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3d831-392c-48f1-8684-74c9185eb5a2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.117078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.117729 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.118039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.118319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] PATH_INFO: `/v3/projects/09a78bed4fac444bba365f738da8e411` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.119497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] RBAC: Authorizing `identity:get_project(project_id=09a78bed4fac444bba365f738da8e411)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.120970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.122693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 231/437] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:42 2022] GET /identity/v3/projects/09a78bed4fac444bba365f738da8e411 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:43.123452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.160633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcb01c-548c-49d1-859e-543ccdf35b09 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.168805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:43.190747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:43.196337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.197000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.197300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.197567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.208318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:43.213670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:43.214729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:43.215681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 207/438] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:43.216434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.237767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9424-2b62-4149-8a48-41306ff15859 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.276145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.276799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.277082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.277566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.278536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.279999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.281813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 232/439] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:43.282410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.327897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75543cd-6522-4e1b-8e15-cb257d5c8ead None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.363975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.364625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.364899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.365172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.366386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.367829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.369501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 208/440] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:43.370271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.393598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f52ccd-13a9-4d5e-b297-3b6fdde5843e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.404780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:43.433910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:43.435098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.435624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.435869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.436317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.437340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:43.437655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.439416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.454289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 233/441] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:43.454289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.475990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b172b855-9903-4c53-bf4d-c240dfe1c727 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.514243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.515078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.515353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.515623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.516413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=96d2ad5552c34a6799019f0c9786745b, scope.project.id=f47d375130964aa590995b8d7151684a) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:43.516718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.518182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.524260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 209/442] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=96d2ad5552c34a6799019f0c9786745b => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:43.541971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.570529 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce6e18-2966-4797-bb4b-3f7abdcba28f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.610106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279bd10-082f-4c4f-8ffd-9b9f19982e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.610762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279bd10-082f-4c4f-8ffd-9b9f19982e15 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.611344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279bd10-082f-4c4f-8ffd-9b9f19982e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.611344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279bd10-082f-4c4f-8ffd-9b9f19982e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.612225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279bd10-082f-4c4f-8ffd-9b9f19982e15 None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=09a78bed4fac444bba365f738da8e411) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:43.612646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279bd10-082f-4c4f-8ffd-9b9f19982e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.614208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279bd10-082f-4c4f-8ffd-9b9f19982e15 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.621508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 234/443] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=09a78bed4fac444bba365f738da8e411&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:43.622842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778e48c-50b2-48ab-824e-94c004287ea6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.623125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778e48c-50b2-48ab-824e-94c004287ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.623398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8778e48c-50b2-48ab-824e-94c004287ea6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.629144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 235/444] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:43.634296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4079-a7ba-42e0-ae37-4010bb8678f2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.634296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4079-a7ba-42e0-ae37-4010bb8678f2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.634296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b4079-a7ba-42e0-ae37-4010bb8678f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.655708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-685b4079-a7ba-42e0-ae37-4010bb8678f2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:43.657278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-685b4079-a7ba-42e0-ae37-4010bb8678f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:43.668461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ca101-bcc5-48ed-9423-571dbb6f0482 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.697146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:43.700436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:43.714691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.715693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.716141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.716605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.759876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 236/445] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:43.784035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4079-a7ba-42e0-ae37-4010bb8678f2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.802815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:43.804292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:43.895727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b4079-a7ba-42e0-ae37-4010bb8678f2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:43.923924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 210/446] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:43.929838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.934057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:43.934710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:43.934986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:43.935258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:43.948519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:43.953675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:43.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:07:43.955357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:43.956422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 237/447] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:43.957250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:43.962795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:43.994993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:44.047970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71e488-3e0c-41cf-86fa-b574e1a9c82b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.085976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1b004-ecb3-4da2-84a4-33aada114013 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.088525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.088525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.088711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.089094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] PATH_INFO: `/v3/projects/f47d375130964aa590995b8d7151684a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.090603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] RBAC: Authorizing `identity:get_project(project_id=f47d375130964aa590995b8d7151684a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.091952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.093392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 211/448] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/projects/f47d375130964aa590995b8d7151684a => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:44.099606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:44.127863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.128489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.128763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.129069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.129796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:44.130124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.131522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.140650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 238/449] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:44.146355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:44.203877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:44.213246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84c85-d8cd-48f3-a0e5-c63157610313 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.232639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:44.245816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.246498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.246781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.247054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] PATH_INFO: `/v3/groups/4933776467404e578553e626287853ce` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.248230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] RBAC: Authorizing `identity:get_group(group_id=4933776467404e578553e626287853ce)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.248323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f0326-f02c-46f2-b596-c0dc120dbbc2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.249683 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.251357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 212/450] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:44 2022] GET /identity/v3/groups/4933776467404e578553e626287853ce => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:44.257146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:44.280988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.281614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.281893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.282193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.349016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.350495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.353527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06164c-4871-4ad3-8f38-400a0f07c117 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.387701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.388317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.388603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.388876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.389669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] RBAC: Adding query filter params (group.id=4933776467404e578553e626287853ce, role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=f47d375130964aa590995b8d7151684a) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:44.390015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.391448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.397331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 213/451] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:44 2022] GET /identity/v3/role_assignments?group.id=4933776467404e578553e626287853ce&scope.project.id=f47d375130964aa590995b8d7151684a&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:44.434735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:44.452382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 239/452] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:07:44.458572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:44.487754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:44.573369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd8b39-5fa4-48e3-88bd-0b88f796762f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.607443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.608026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.608306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.608583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] PATH_INFO: `/v3/projects/d85d95c8bfc045dbb053756109fbe722` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.609788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] RBAC: Authorizing `identity:get_project(project_id=d85d95c8bfc045dbb053756109fbe722)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.611277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.612986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 214/453] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:07:44 2022] GET /identity/v3/projects/d85d95c8bfc045dbb053756109fbe722 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:44.618847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:44.722871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21191151-824c-4c00-b693-d86fd5bcb093 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.756112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571e01b-4790-4f05-a8a0-f552f04755bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.756759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e01b-4790-4f05-a8a0-f552f04755bf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.757041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e01b-4790-4f05-a8a0-f552f04755bf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.757315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571e01b-4790-4f05-a8a0-f552f04755bf None admin] PATH_INFO: `/v3/groups/86edb48a955f4d1d9b746c4c0d43cf1c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.758494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571e01b-4790-4f05-a8a0-f552f04755bf None admin] RBAC: Authorizing `identity:get_group(group_id=86edb48a955f4d1d9b746c4c0d43cf1c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.759975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571e01b-4790-4f05-a8a0-f552f04755bf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.761599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 240/454] 10.222.0.17 () {56 vars in 1180 bytes} [Sat Aug 6 01:07:44 2022] GET /identity/v3/groups/86edb48a955f4d1d9b746c4c0d43cf1c => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:44.767595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:44.859799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:44.869553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4be8f1-4260-4869-90c3-bbb7b0afaad0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:44.903687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03273a-a4a1-4b52-86ab-328465c42275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:44.904296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03273a-a4a1-4b52-86ab-328465c42275 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:44.904576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03273a-a4a1-4b52-86ab-328465c42275 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:44.904882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03273a-a4a1-4b52-86ab-328465c42275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:44.905643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03273a-a4a1-4b52-86ab-328465c42275 None admin] RBAC: Adding query filter params (group.id=86edb48a955f4d1d9b746c4c0d43cf1c, role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=d85d95c8bfc045dbb053756109fbe722) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:44.905961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03273a-a4a1-4b52-86ab-328465c42275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:44.907478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03273a-a4a1-4b52-86ab-328465c42275 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:44.913613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 215/455] 10.222.0.17 () {56 vars in 1376 bytes} [Sat Aug 6 01:07:44 2022] GET /identity/v3/role_assignments?group.id=86edb48a955f4d1d9b746c4c0d43cf1c&scope.project.id=d85d95c8bfc045dbb053756109fbe722&role.id=1aa37aeab6694470b737775bf433503d => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:47.256071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7bb7d-e98a-45e9-be74-085eada460d6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.256638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7bb7d-e98a-45e9-be74-085eada460d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.256906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7bb7d-e98a-45e9-be74-085eada460d6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:47.258444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 241/456] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:47.263785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852fed-cdf6-4711-bac0-1be51bd741cd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.264195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852fed-cdf6-4711-bac0-1be51bd741cd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.264361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852fed-cdf6-4711-bac0-1be51bd741cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:47.290936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-00852fed-cdf6-4711-bac0-1be51bd741cd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:47.292137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-00852fed-cdf6-4711-bac0-1be51bd741cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:47.375137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 216/457] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:47.400565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7bb7d-e98a-45e9-be74-085eada460d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:47.468601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:47.535082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7bb7d-e98a-45e9-be74-085eada460d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:47.583661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19a122-c31c-4d3c-acba-1302477ae8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:47.584373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a122-c31c-4d3c-acba-1302477ae8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.584658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a122-c31c-4d3c-acba-1302477ae8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.584928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19a122-c31c-4d3c-acba-1302477ae8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:47.597489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19a122-c31c-4d3c-acba-1302477ae8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:47.599223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19a122-c31c-4d3c-acba-1302477ae8f1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ce19a122-c31c-4d3c-acba-1302477ae8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:47.618149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:47.619064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:47.620533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:47.620533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:47.620533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:47.620533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:47.620533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 242/458] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:47.625202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852fed-cdf6-4711-bac0-1be51bd741cd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:47.636487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510291e2-467f-4794-b349-3daf70f1c104 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.636767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510291e2-467f-4794-b349-3daf70f1c104 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.637040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510291e2-467f-4794-b349-3daf70f1c104 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:47.639640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 243/459] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:47.646696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aa893-b1f7-4f15-a9f7-d2860792e721 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.646972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aa893-b1f7-4f15-a9f7-d2860792e721 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.647244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91aa893-b1f7-4f15-a9f7-d2860792e721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:47.675601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f91aa893-b1f7-4f15-a9f7-d2860792e721 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:47.676816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f91aa893-b1f7-4f15-a9f7-d2860792e721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:47.771969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:47.800840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852fed-cdf6-4711-bac0-1be51bd741cd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:47.805019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 244/460] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:47.840473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aa893-b1f7-4f15-a9f7-d2860792e721 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:47.849133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf314296-f7b8-4324-b46c-68e19296035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:47.850151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf314296-f7b8-4324-b46c-68e19296035a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.850749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf314296-f7b8-4324-b46c-68e19296035a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.851032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf314296-f7b8-4324-b46c-68e19296035a None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:47.851748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf314296-f7b8-4324-b46c-68e19296035a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:47.852067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf314296-f7b8-4324-b46c-68e19296035a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:47.853551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf314296-f7b8-4324-b46c-68e19296035a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:47.866364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 217/461] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:47.871184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3010-d78b-4017-9664-62cabd254635 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.871184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3010-d78b-4017-9664-62cabd254635 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.871184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3010-d78b-4017-9664-62cabd254635 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:47.871184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 218/462] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:47.874772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d3010-d78b-4017-9664-62cabd254635 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:47.884448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:47.962105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91aa893-b1f7-4f15-a9f7-d2860792e721 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:47.992870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d3010-d78b-4017-9664-62cabd254635 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:47.998029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7b650-5d7f-4672-9709-9eee30db0572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:47.998710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b650-5d7f-4672-9709-9eee30db0572 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:47.999012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b650-5d7f-4672-9709-9eee30db0572 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:47.999325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7b650-5d7f-4672-9709-9eee30db0572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.010455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7b650-5d7f-4672-9709-9eee30db0572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.011931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7b650-5d7f-4672-9709-9eee30db0572 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-16e7b650-5d7f-4672-9709-9eee30db0572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:48.026843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:48.027709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:48.029192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:48.029192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:48.029192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:48.029192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:48.029192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 245/463] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:48.029460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9534a-5e60-496b-b53d-8af3ffe6a3a7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.029655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9534a-5e60-496b-b53d-8af3ffe6a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.029918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9534a-5e60-496b-b53d-8af3ffe6a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.033775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fcd10-fd96-4213-a872-e950744a2ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.034448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fcd10-fd96-4213-a872-e950744a2ff0 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.034732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fcd10-fd96-4213-a872-e950744a2ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.035010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fcd10-fd96-4213-a872-e950744a2ff0 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.035769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fcd10-fd96-4213-a872-e950744a2ff0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.037212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fcd10-fd96-4213-a872-e950744a2ff0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.048752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7ad9534a-5e60-496b-b53d-8af3ffe6a3a7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:48.050714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ad9534a-5e60-496b-b53d-8af3ffe6a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:48.059882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 219/464] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:47 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:48.060933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131897-3fb7-4d4d-b020-43a61f0b93bb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.061223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131897-3fb7-4d4d-b020-43a61f0b93bb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.061502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131897-3fb7-4d4d-b020-43a61f0b93bb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.062925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 220/465] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:48.067886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88131897-3fb7-4d4d-b020-43a61f0b93bb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:48.071213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:48.152524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 246/466] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:48.154114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c276b-4a4b-4cc5-899d-d488debe8136 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.154471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c276b-4a4b-4cc5-899d-d488debe8136 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.154740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c276b-4a4b-4cc5-899d-d488debe8136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.176445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-061c276b-4a4b-4cc5-899d-d488debe8136 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:48.177800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-061c276b-4a4b-4cc5-899d-d488debe8136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:48.204588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:48.210981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88131897-3fb7-4d4d-b020-43a61f0b93bb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:48.256829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.257456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.257789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.258142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.258844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:48.259145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.260663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.273151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 221/467] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:48.274336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:48.276200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 247/468] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:48.284308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c276b-4a4b-4cc5-899d-d488debe8136 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:48.346227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:48.394121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6c8c7-ebbc-4a46-84cd-d4ba80dc0002 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:48.411440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c276b-4a4b-4cc5-899d-d488debe8136 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:48.433124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.433781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.434085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.434354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.446666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.448126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.452962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.453908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.454487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.455005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.456274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.458695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:48.463431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:48.464308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:48.465397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:48.465397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:48.465397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:48.465397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:48.465397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 222/469] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:48.470300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:48.487557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 248/470] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:48 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:48.494529 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:48.499897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:48.602804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d22205-2044-4807-9f4a-9a962bde5793 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:48.619318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:48.660137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.660816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.661090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.661359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.686741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.688481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:48.704783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:48.705768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:48.706854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:48.706854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:48.706854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:48.706854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:48.706854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 223/471] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:48.712024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:48.732672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b112551-8a6f-4d83-8459-8b6d457465a0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:48.771609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.772242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.772519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.772789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.773594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:48.773897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.775324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.789651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 249/472] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:48.797098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:48.837849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c70c4a-c464-44ff-9167-925bc521c039 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:48.874758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:48.877949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962c43d-903b-4f97-b36d-55cff21dd03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.877949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c43d-903b-4f97-b36d-55cff21dd03d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.877949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c43d-903b-4f97-b36d-55cff21dd03d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.877949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962c43d-903b-4f97-b36d-55cff21dd03d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.878264 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c43d-903b-4f97-b36d-55cff21dd03d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:48.878264 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c43d-903b-4f97-b36d-55cff21dd03d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.879715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962c43d-903b-4f97-b36d-55cff21dd03d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.893802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 224/473] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:48.895155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e7140-1429-496f-a4a1-af4f191154f2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.895439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e7140-1429-496f-a4a1-af4f191154f2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.895715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e7140-1429-496f-a4a1-af4f191154f2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.897168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 225/474] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:48.902370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf67769-7684-4a97-a023-f8f591de31a6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.902649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf67769-7684-4a97-a023-f8f591de31a6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.902923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf67769-7684-4a97-a023-f8f591de31a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.920690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0421e-b428-4cc0-b29d-47b7a930cf5d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:48.921263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cbf67769-7684-4a97-a023-f8f591de31a6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:48.922490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cbf67769-7684-4a97-a023-f8f591de31a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:48.943115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:48.957878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:48.958532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:48.958808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:48.959080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:48.959769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:48.961237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:48.991916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 250/475] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:48 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:48.993076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:49.039412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 226/476] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:49.075345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf67769-7684-4a97-a023-f8f591de31a6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:49.110545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6f2e4-435d-4ccf-a78c-7dd55e690d65 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:49.134456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:49.151330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:49.151979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:49.152255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:49.152525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:49.153207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:49.154808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:49.184934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 251/477] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:48 2022] POST /identity/v3/users => generated 249 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:49.244098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf67769-7684-4a97-a023-f8f591de31a6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:49.287053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:49.287736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:49.287968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:49.288244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:49.289046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:49.290557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:49.303045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.sql.core [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 01:07:49.303045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 01:07:49.303045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [parameters: {'id': '47029c83a2db4302bea5bf39a60e6ccc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 01:07:49.303045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Aug 06 01:07:49.319433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return ref.to_dict() Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:07:49.320437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application yield resource Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise self.value Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application session.commit() Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 01:07:49.321363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.flush() Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application compat.raise_( Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 01:07:49.322249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:07:49.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:07:49.323928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [parameters: {'id': '47029c83a2db4302bea5bf39a60e6ccc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:49.324706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 06 01:07:49.325515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:49.328353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 227/478] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 01:07:49 2022] POST /identity/v3/roles => generated 144 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:49.335757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:49.471576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92be4d-baa0-4760-9975-ed2f28c49695 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:49.513018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e39174-1799-405f-86be-f14eebb3f5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:49.513753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39174-1799-405f-86be-f14eebb3f5fc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:49.514063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39174-1799-405f-86be-f14eebb3f5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:49.514340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39174-1799-405f-86be-f14eebb3f5fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:49.528588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e39174-1799-405f-86be-f14eebb3f5fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-70e39174-1799-405f-86be-f14eebb3f5fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:49.535161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:49.536050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:49.536852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 252/479] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:07:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:49.543786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:49.572625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:49.658764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9bc59-2e6e-4688-98c5-dba6f448a187 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:49.701365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3504e0-4ae2-4421-9519-fc512a25d8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:49.702348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3504e0-4ae2-4421-9519-fc512a25d8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:49.702761 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3504e0-4ae2-4421-9519-fc512a25d8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:49.703182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3504e0-4ae2-4421-9519-fc512a25d8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:49.704040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3504e0-4ae2-4421-9519-fc512a25d8b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:49.704496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3504e0-4ae2-4421-9519-fc512a25d8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:49.706037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3504e0-4ae2-4421-9519-fc512a25d8b1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:49.715075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 228/480] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:50.464333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268364-7645-4c6b-bbc0-c552072ee619 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:50.464896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268364-7645-4c6b-bbc0-c552072ee619 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:50.464896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e268364-7645-4c6b-bbc0-c552072ee619 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:50.466526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 253/481] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:50.471384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dd40d-8981-4ea4-894a-aa2077fafaab None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:50.471779 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dd40d-8981-4ea4-894a-aa2077fafaab None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:50.471938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dd40d-8981-4ea4-894a-aa2077fafaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:50.493976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8a6dd40d-8981-4ea4-894a-aa2077fafaab None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:50.495157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8a6dd40d-8981-4ea4-894a-aa2077fafaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:50.591633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 229/482] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:50.634893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268364-7645-4c6b-bbc0-c552072ee619 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:50.687262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:50.776284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e268364-7645-4c6b-bbc0-c552072ee619 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:50.811786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:50.812434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:50.812706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:50.812975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:50.818398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee6d3-37d3-47ce-9efd-ec91cc55404e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:50.818687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee6d3-37d3-47ce-9efd-ec91cc55404e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:50.818958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cee6d3-37d3-47ce-9efd-ec91cc55404e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:50.821597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 230/483] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:50.823715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:50.825577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badced9d-43e4-452a-be76-b803d6566fdc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:50.825861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badced9d-43e4-452a-be76-b803d6566fdc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:50.826160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badced9d-43e4-452a-be76-b803d6566fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:50.828752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:50.829622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:50.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 254/484] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:50.835951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:50.862322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-badced9d-43e4-452a-be76-b803d6566fdc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:50.863839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-badced9d-43e4-452a-be76-b803d6566fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:50.878370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:51.000565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:51.000785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 231/485] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:51.007928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb491a-4c68-47b1-b61b-ad0969bbc5ed None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.035596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badced9d-43e4-452a-be76-b803d6566fdc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.045424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.046406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.046902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.047365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.048386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:51.048880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:51.050605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:51.060034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 255/486] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:51.065839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.171844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21b520-dc48-4892-a7c7-ebb9a067dabc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.209315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.210388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.210888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.211415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.223373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:51.225245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:51.240573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:51.241451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:51.242361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:51.242361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:51.242361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:51.242361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:51.244569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 256/487] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:51.250083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.263784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:51.296862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badced9d-43e4-452a-be76-b803d6566fdc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.358930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a240fc3-9d98-4110-ad0c-64e5bdb54713 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.379861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.380527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.380807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.381081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.391606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:51.398435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:51.399794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:51.400601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 232/488] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:51.401323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.405978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.405978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.405978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.406221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.408948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:51.409276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:51.409600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:51.411118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:51.438881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 257/489] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:51.442941 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.580986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:51.596660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85ab3-e508-4ad6-aa6a-d8c55a898a4c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.637361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbf314-95f0-48ac-9ce2-10469c0b56ba None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.656364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.656994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.657273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.657546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.658660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:51.658970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:51.660414 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:51.669177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 233/490] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:51.674555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.717879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0b79-7604-41e2-9e29-bdaa54428b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.719072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0b79-7604-41e2-9e29-bdaa54428b82 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.719495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0b79-7604-41e2-9e29-bdaa54428b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.720265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0b79-7604-41e2-9e29-bdaa54428b82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.732861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d0b79-7604-41e2-9e29-bdaa54428b82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:51.735575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d0b79-7604-41e2-9e29-bdaa54428b82 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-734d0b79-7604-41e2-9e29-bdaa54428b82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:07:51.754099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:51.755095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:51.755980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 258/491] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:51.758271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb153a4-030a-43cc-afae-15f409ef2e0b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.758271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb153a4-030a-43cc-afae-15f409ef2e0b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.758271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb153a4-030a-43cc-afae-15f409ef2e0b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.759702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:51.761443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 259/492] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:51.763569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb153a4-030a-43cc-afae-15f409ef2e0b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.805963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d7510-1b28-415a-a10c-9959de39e6ff None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.841566 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4428cab5-05f2-4647-b629-c8a8a870cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.842450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428cab5-05f2-4647-b629-c8a8a870cd6c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.842868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428cab5-05f2-4647-b629-c8a8a870cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.843301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4428cab5-05f2-4647-b629-c8a8a870cd6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.854919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428cab5-05f2-4647-b629-c8a8a870cd6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:51.856686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4428cab5-05f2-4647-b629-c8a8a870cd6c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4428cab5-05f2-4647-b629-c8a8a870cd6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:51.871892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:51.872943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:51.874019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:51.874019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:51.874019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:51.874019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:51.875622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 234/493] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:51.876775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa47e01-86a0-4da5-864c-e35f2051168e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.877054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa47e01-86a0-4da5-864c-e35f2051168e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.877325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa47e01-86a0-4da5-864c-e35f2051168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.883274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb153a4-030a-43cc-afae-15f409ef2e0b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:51.895450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2fa47e01-86a0-4da5-864c-e35f2051168e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:51.896760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2fa47e01-86a0-4da5-864c-e35f2051168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:51.912497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:51.918669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6dc54-5786-4adc-9953-5c9802959587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:51.919278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6dc54-5786-4adc-9953-5c9802959587 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.919558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6dc54-5786-4adc-9953-5c9802959587 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.919831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6dc54-5786-4adc-9953-5c9802959587 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.920628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6dc54-5786-4adc-9953-5c9802959587 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:51.920933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6dc54-5786-4adc-9953-5c9802959587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:51.922455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6dc54-5786-4adc-9953-5c9802959587 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:51.959209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 260/494] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:51.960471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a4ec-0c4d-47e5-9827-3105ce593e02 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:51.960755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a4ec-0c4d-47e5-9827-3105ce593e02 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:51.961024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36a4ec-0c4d-47e5-9827-3105ce593e02 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:51.962398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 261/495] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:51.967007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36a4ec-0c4d-47e5-9827-3105ce593e02 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:51.971838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 235/496] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:51.972758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa47e01-86a0-4da5-864c-e35f2051168e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.026889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.084631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa47e01-86a0-4da5-864c-e35f2051168e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.092235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36a4ec-0c4d-47e5-9827-3105ce593e02 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.120404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.121128 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.121491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.121830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.129111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189a95-7a85-4886-8377-c21e144b3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.129732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189a95-7a85-4886-8377-c21e144b3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.130432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189a95-7a85-4886-8377-c21e144b3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.130432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189a95-7a85-4886-8377-c21e144b3dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.131060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189a95-7a85-4886-8377-c21e144b3dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:52.131365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189a95-7a85-4886-8377-c21e144b3dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.132950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189a95-7a85-4886-8377-c21e144b3dd2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.144182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 262/497] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:52.145557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2abe3-8bb0-4408-abf2-02302bc54a2f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.145845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2abe3-8bb0-4408-abf2-02302bc54a2f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.146146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2abe3-8bb0-4408-abf2-02302bc54a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.164005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ead2abe3-8bb0-4408-abf2-02302bc54a2f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:52.165196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ead2abe3-8bb0-4408-abf2-02302bc54a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:52.200150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.201662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.212731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.253964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 263/498] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:52.253964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2abe3-8bb0-4408-abf2-02302bc54a2f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.254234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.308303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 236/499] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:52.313150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.361080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2abe3-8bb0-4408-abf2-02302bc54a2f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.394819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.395459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.395738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.396010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.405999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:52.411383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:52.412428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 264/500] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:52.413503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.416559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a5cc-4ced-4ba4-ad35-7f759d32658c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.452380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.453185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.453466 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.453737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.459423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.461200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.462876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:07:52.475612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:52.476649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:52.477564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 237/501] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:52.478150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.486768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.525714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4cfbe-8b5d-4bb4-a581-48fe5ffbeffb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.559365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.560001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.560280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.560547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.570262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:52.575107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:52.575949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:52.576749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 265/502] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:52.577405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.578177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d14de-0d8a-4645-9629-3edf6d7c289e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.615256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0eca-4135-481b-a6e2-4d9f02ade91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.615865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0eca-4135-481b-a6e2-4d9f02ade91f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.616091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0eca-4135-481b-a6e2-4d9f02ade91f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.616358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0eca-4135-481b-a6e2-4d9f02ade91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.626842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0eca-4135-481b-a6e2-4d9f02ade91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.628310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0eca-4135-481b-a6e2-4d9f02ade91f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-95ca0eca-4135-481b-a6e2-4d9f02ade91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:52.642483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:52.643495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:52.644352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:52.644352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:52.644352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:52.644352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:52.644352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 238/503] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:52.645007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85693-dd0b-4fe6-89d6-3049153aeb15 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.645208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85693-dd0b-4fe6-89d6-3049153aeb15 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.645453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d85693-dd0b-4fe6-89d6-3049153aeb15 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.646835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 239/504] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:52.647455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d85693-dd0b-4fe6-89d6-3049153aeb15 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.675368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.679796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f644cef-7ae2-4d03-8d00-4c8846cefe02 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.706296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.713524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.714175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.714462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.714729 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.715474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:52.715778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.717180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.724912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 266/505] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:52.725680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.753255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d85693-dd0b-4fe6-89d6-3049153aeb15 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.787265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.787900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.788172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.788441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.789227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:52.789530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.790993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.824196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32b6c4-5cdb-4a8a-a6f6-ea9ef6550a43 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.826180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 240/506] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:52.829497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.859820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d66217-49b4-41d6-9867-00b09735e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.860573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66217-49b4-41d6-9867-00b09735e771 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.860846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66217-49b4-41d6-9867-00b09735e771 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.861123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d66217-49b4-41d6-9867-00b09735e771 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.861843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66217-49b4-41d6-9867-00b09735e771 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:52.862184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66217-49b4-41d6-9867-00b09735e771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.863650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d66217-49b4-41d6-9867-00b09735e771 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.871696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 267/507] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:52.872906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582c02-ef47-43e6-bbcc-78a76d3feeb2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.873255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582c02-ef47-43e6-bbcc-78a76d3feeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.873593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af582c02-ef47-43e6-bbcc-78a76d3feeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.891339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-af582c02-ef47-43e6-bbcc-78a76d3feeb2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:52.892644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-af582c02-ef47-43e6-bbcc-78a76d3feeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:52.909281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.927526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e8f93-a6bb-47d4-860f-863c1e5c6d33 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:52.943605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:52.957597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 268/508] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:52.967015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582c02-ef47-43e6-bbcc-78a76d3feeb2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:52.967142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:52.967142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:52.967142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:52.967142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:52.967482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:52.967482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:52.967482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:52.981985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 241/509] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:52.981985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.057058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af582c02-ef47-43e6-bbcc-78a76d3feeb2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.083320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782a7d-b709-4291-882e-733151a0d977 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.090938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.091587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.091851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.092128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.101921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.103426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.116624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.117268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.117542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.117806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:53.118216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:53.119206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:53.120449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:53.120449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:53.120449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.120449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:53.120449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 269/510] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:53.120449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.123847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.167068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.192083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.193644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.219987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93472914-1096-4a50-bc71-bdb886a2bee0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.252338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.252972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.253251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.253527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.263701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.265151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:53.278929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:53.279876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:53.286201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:53.286201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:53.286201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.286201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:53.286201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 270/511] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:53.286201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.292036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 242/512] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:53.292869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.343593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.369439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.387908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efc269-78e7-4d27-82d3-692cd97265f7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.392655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff73dbb-ec07-4303-8526-6770cd8852b9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.422339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.422981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.423259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.423528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.428184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.428823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.429101 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.429368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.434489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.435912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.435999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.437611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:07:53.449215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:53.450200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:53.451165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:53.451657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:53.452498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:53.453355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:53.453355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:53.453355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.453355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:53.453559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 243/513] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:53.453559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.453695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 271/514] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:53.453695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.551167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70e74c-d9c8-4d7f-8fa9-1fc84fa189d4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.554682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f78d2-46f9-4a52-b5d8-bea830d5d4e9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.563439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.584988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.585586 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.585859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.586156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.586840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:53.587141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.588522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.589265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.589885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.590205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.590479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.591168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:53.591445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.591537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.593080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.601283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 244/515] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:53.602864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.609345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 272/516] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:53.609345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.708993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653a85c-62e9-4436-8a26-a13b8ce7f40e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.709591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec846fb-d8db-4eae-b327-7698bb5188f0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.742803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.743331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.743500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.743679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.743949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.744098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.744187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.744491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.744701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:53.744997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.746485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.755043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.756492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.764970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 273/517] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:53.766057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:53.770772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:53.771627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:53.772462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:53.772462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:53.772462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:53.772462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:53.772709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 245/518] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:53.773467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.794407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.821453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:53.865956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a4b8a-0b34-4d49-9ae6-f2bf40cee682 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.871378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbab6c3-16b3-4a9a-8350-f30008755871 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:53.899749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.900373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.900651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.900919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.901613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:53.901920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.903380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.905745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:53.906102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:53.906383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:53.906653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:53.914492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:53.914653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 274/519] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:53.915429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:53.915922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:07:53.928448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:53.929390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:53.930311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 246/520] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:53.930867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.004205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.016621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5064258-c521-460f-8ca8-b39b08dc1476 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.028815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a748a7d9-3952-42e2-b305-166f4b863e4c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.037950 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.049887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.050666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.050958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.051234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.058701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.060186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.062258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.062874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.063147 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.063413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.064198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=2d0553dc133749eab4777d6552a93178) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:54.064504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.065948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:07:54.071232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:54.072081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:07:54.072967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:54.073461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 247/521] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/role_assignments?user.id=2d0553dc133749eab4777d6552a93178&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:54.073461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.073587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 275/522] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:54.073587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.190286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3141cc4-d1f7-4d9a-afd9-46083be7fb5b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.200354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919236fe-cb6d-421d-a374-9550274986a1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.232399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.233413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.233697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.234004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.234695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.236171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.238939 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.239570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.239849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.240119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.240819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:54.241122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.242533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.260828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 248/523] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:54.260828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.266075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 276/524] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:07:54 2022] POST /identity/v3/users => generated 247 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:07:54.266959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.271992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.317474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.390736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a360c-85b0-4de0-a958-32b46d090cfc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.420572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17213a77-6d5a-437c-bfe8-912eb0c319d4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.439696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.440400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.440684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.440962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.441809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:54.442165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.444190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.467936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 277/525] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 01:07:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:54.471885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.478238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.478879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.479158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.479429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.480235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:54.480542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.482759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.503860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 249/526] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Aug 6 01:07:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:54.505789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.551795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.598989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356df4e-062f-4faa-97e3-51093aab3b07 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.613170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.633007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb097-20c1-4a38-9724-1ec8b860d75b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.642724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.643432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.643716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.643987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.651053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.652543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:07:54.665131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:54.666029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:54.666894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 278/527] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:54.667874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.673782 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.674449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.674728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.675001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.771061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.771974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c93e-ad38-47df-9273-15eddda23c62 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:54.772577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:54.795949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.818194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:54.823244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:54.823595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:54.823940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:54.887355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:54.901921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 250/528] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:54.902954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:54.916957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:54.919044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.026011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682499f-311c-41a0-9814-190bee3d26a4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.048124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 279/529] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:07:55.049273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.062829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.063757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.064222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.064673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.065603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:55.066179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.067831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.075769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:55.087334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 251/530] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:07:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:55.088380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.145461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:55.161145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f01c7b-0df3-4d2e-8b59-ef09bf526e38 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.198436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.199197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.199567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.199967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.202981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e820878-6c14-4b17-b8ee-bdec8c450a28 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.210795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.212354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:55.227631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:55.228532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:55.229387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:55.229387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:55.229387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:55.229387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:55.233541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 280/531] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:55.234504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.242713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.243672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.244129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.244578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.255745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.257491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:55.273505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:55.274381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:55.275214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:55.275214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:55.275214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:55.275214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:55.277453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 252/532] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:55.278474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.313470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:55.340102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9ed03-cc23-4947-b6fe-b52e70e8b914 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.374075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.374835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.374944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.375224 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.376072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=b52057428b6444fbbb5d182ab8a2c80a) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:55.376311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.377837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.384801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a677f1-2f66-4927-bfcd-249b03912940 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.386688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:55.390402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 281/533] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/role_assignments?user.id=b52057428b6444fbbb5d182ab8a2c80a&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:55.391540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.426179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.427193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.427701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.428171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.429081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:55.429584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.431231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.444978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 253/534] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:55.451095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.571850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41f496-f55b-4e7a-8c8d-ef6885199e4d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.609918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.611056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.611541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.612011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.620236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e911f8-0bd2-4b4d-9f15-bed8b3eec38a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.620577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.622324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:07:55.635518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:55.636442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:55.637315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:55.639672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 254/535] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:55.645573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.672033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:55.708367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.709241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.709358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.709605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.710348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:55.710647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.712055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.722993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:55.733044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 282/536] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:55.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.752192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5665e19-fe98-453c-8d57-cb6c077fd9fc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.789919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.791934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.792651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.793335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.794511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:55.795035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.796716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.809843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 255/537] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:55.816155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:55.900672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:55.920106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da88a4-7043-4903-9fc8-285400a92623 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.932126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed9cb-3ccf-4de3-9d73-cbd6d46dcccf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:55.955449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:55.956454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:55.957000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:55.957472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:55.958540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=0131e4a3492c42c492c47a715a2bccaf) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:55.959051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:55.960705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:55.966915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 256/538] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/role_assignments?user.id=0131e4a3492c42c492c47a715a2bccaf&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:56.004434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0485b-3e1f-4239-be34-26f928b9af19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:56.005121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0485b-3e1f-4239-be34-26f928b9af19 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.005403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0485b-3e1f-4239-be34-26f928b9af19 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.005681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0485b-3e1f-4239-be34-26f928b9af19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.013459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0485b-3e1f-4239-be34-26f928b9af19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:56.015034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0485b-3e1f-4239-be34-26f928b9af19 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8fe0485b-3e1f-4239-be34-26f928b9af19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:07:56.027785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:56.028702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:56.029538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:56.034076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 283/539] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:56.035854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:56.176915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e1c1b-ae22-4ebe-a2e4-5f32dde52cf4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:56.193415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce931f0-99ca-4304-9c93-016a0a44abf7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.193740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce931f0-99ca-4304-9c93-016a0a44abf7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.193990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce931f0-99ca-4304-9c93-016a0a44abf7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.195648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 284/540] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:56.201003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283580-c0c4-48db-8ddf-61c689481653 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.201272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283580-c0c4-48db-8ddf-61c689481653 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.201554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3283580-c0c4-48db-8ddf-61c689481653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.213418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:56.214095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.214379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.214652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.215410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:56.215719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:56.217245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:56.222583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3283580-c0c4-48db-8ddf-61c689481653 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:56.223814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3283580-c0c4-48db-8ddf-61c689481653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:56.230613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 257/541] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:56.239072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:56.267347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:56.322947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:56.353741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 285/542] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:07:56.388390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d566d-2589-4725-9a72-d9ae7398b6d4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:56.398425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283580-c0c4-48db-8ddf-61c689481653 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:56.456241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebea08-1380-497f-8e1e-796619f6fb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:56.456850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebea08-1380-497f-8e1e-796619f6fb49 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.457127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebea08-1380-497f-8e1e-796619f6fb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.457396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebea08-1380-497f-8e1e-796619f6fb49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.458244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebea08-1380-497f-8e1e-796619f6fb49 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=ed70b6997f064f3f8fa68dea2a6eb470) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:56.458556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebea08-1380-497f-8e1e-796619f6fb49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:56.459997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebea08-1380-497f-8e1e-796619f6fb49 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:56.466501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 258/543] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:07:56 2022] GET /identity/v3/role_assignments?user.id=ed70b6997f064f3f8fa68dea2a6eb470&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:56.509126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1535e5-0270-4b30-b835-1f46d2babbee None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.509126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1535e5-0270-4b30-b835-1f46d2babbee None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.509126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1535e5-0270-4b30-b835-1f46d2babbee None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.512526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 259/544] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:07:56.519607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bbffe-7af2-4ffd-b8a5-b08a2f7ce55d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.519927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bbffe-7af2-4ffd-b8a5-b08a2f7ce55d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.520167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bbffe-7af2-4ffd-b8a5-b08a2f7ce55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.558716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b97bbffe-7af2-4ffd-b8a5-b08a2f7ce55d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:56.559996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b97bbffe-7af2-4ffd-b8a5-b08a2f7ce55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:56.603794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3283580-c0c4-48db-8ddf-61c689481653 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:56.662112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:56.662778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.663062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.663332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.681031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:56.681201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:56.686716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:56.688138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:56.689381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:56.690227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 286/545] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:56.692489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 260/546] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:56.698367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:56.742955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bbffe-7af2-4ffd-b8a5-b08a2f7ce55d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:56.787800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:56.874047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaedf60-90e4-4c1f-8600-7954b5324baf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:56.919246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bbffe-7af2-4ffd-b8a5-b08a2f7ce55d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:56.940790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:56.941468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.941741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.942035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:56.942766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:56.943080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:56.944504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:56.961709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 287/547] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:56.965718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:56.986043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:56.986709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:56.986994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:56.987268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.007533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:57.012412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:57.013288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:57.014121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:57.016552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 261/548] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:57.021764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:57.098771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:57.140695 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec5f44-3457-4c8b-af83-0aa6570eb14c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:57.181383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1d85-4a48-47c6-b660-64fb47d69854 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:57.181599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:57.181599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:57.181599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:57.181599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.182273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:57.185222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:57.185222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:57.194965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 262/549] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:57.200634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:57.202504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:57.270598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:57.271162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:57.271437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:57.271708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.283044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:57.284530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:57.298686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:57.300471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:57.301814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:57.301814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:57.301814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:57.301814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:57.301814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 288/550] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:57.305563 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:57.313005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67898e-b1fd-4300-b82e-600f97dab38c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:57.356890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:57.381246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:57.381909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:57.382609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:57.382885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.402467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:57.404323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:57.431058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:57.432005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:57.432881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:57.432881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:57.432881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:57.432881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:57.437337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 263/551] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:57.448755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:57.498533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df952e2d-4382-4de5-9b0d-253951ba3f9e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:57.570831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:57.571381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:57.571709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:57.571986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.572694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:57.573417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:57.574564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:57.585634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97be2be6-51ac-48c0-b3e7-e51f63ef9265 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:57.597905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 289/552] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:57.603396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:57.620694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:57.621605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:57.622124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:57.622618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.623509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:57.624035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:57.625608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:57.627343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:57.638447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 264/553] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:57.651066 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:57.713476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:57.715210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7609da-04fb-493d-946d-1a8472833b33 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:57.778472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4502a69-5878-4532-98e6-50c17de89a40 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:57.816798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:57.817464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:57.817735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:57.818372 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.826254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:57.827656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:57.830000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:57.830657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:57.830934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:57.831206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:57.843144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:57.844633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:07:57.851944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:57.853021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:57.853952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 265/554] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:07:57.857054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:57.859496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:57.862299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 290/555] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:07:57.864077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:57.868183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.005310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.021483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.030194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558619b-189d-46c1-a56b-5d2e83fe50e1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.030919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d02a1-67d9-4856-9427-db3ae0606eea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.071054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165bfe2-b9b8-4aaa-809c-da6c83177a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.071689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165bfe2-b9b8-4aaa-809c-da6c83177a23 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.071988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165bfe2-b9b8-4aaa-809c-da6c83177a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.072443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165bfe2-b9b8-4aaa-809c-da6c83177a23 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.073198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165bfe2-b9b8-4aaa-809c-da6c83177a23 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:58.073431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165bfe2-b9b8-4aaa-809c-da6c83177a23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.074910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165bfe2-b9b8-4aaa-809c-da6c83177a23 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.078680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964ad6d-eeb6-4164-b15e-cd7b930db3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.079247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964ad6d-eeb6-4164-b15e-cd7b930db3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.079526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964ad6d-eeb6-4164-b15e-cd7b930db3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.079799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964ad6d-eeb6-4164-b15e-cd7b930db3c5 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.080595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964ad6d-eeb6-4164-b15e-cd7b930db3c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:58.080903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964ad6d-eeb6-4164-b15e-cd7b930db3c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.082423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964ad6d-eeb6-4164-b15e-cd7b930db3c5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.096295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 266/556] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:07:58.097871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c03c4b-0bc9-44d9-bda0-a40bdcf0eb96 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.098358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c03c4b-0bc9-44d9-bda0-a40bdcf0eb96 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.098799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c03c4b-0bc9-44d9-bda0-a40bdcf0eb96 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.100475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 267/557] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:58.106050 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c03c4b-0bc9-44d9-bda0-a40bdcf0eb96 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.111824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 291/558] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:07:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:58.113555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b432ee-f1ef-4587-943b-1ddde751a75e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.114052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b432ee-f1ef-4587-943b-1ddde751a75e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.114628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b432ee-f1ef-4587-943b-1ddde751a75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.133114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e3b432ee-f1ef-4587-943b-1ddde751a75e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:58.134573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e3b432ee-f1ef-4587-943b-1ddde751a75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:58.207429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 292/559] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:58.208654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b432ee-f1ef-4587-943b-1ddde751a75e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.215273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c03c4b-0bc9-44d9-bda0-a40bdcf0eb96 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.250783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c127df-510f-4103-b79a-3b34e9d661c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.251415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c127df-510f-4103-b79a-3b34e9d661c4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.251693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c127df-510f-4103-b79a-3b34e9d661c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.251962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c127df-510f-4103-b79a-3b34e9d661c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.274274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.286557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.321600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b432ee-f1ef-4587-943b-1ddde751a75e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.323117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c127df-510f-4103-b79a-3b34e9d661c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.325217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c127df-510f-4103-b79a-3b34e9d661c4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.358724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.359293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.359567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.359836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.375924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.377421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:58.392478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:58.393383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:58.394377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:58.394377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:58.394377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:58.394377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:58.394377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 293/560] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:58.394679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.432966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 268/561] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:07:58.434645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d06c7-5685-426c-b503-6f0e77f27b5d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.435441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d06c7-5685-426c-b503-6f0e77f27b5d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.436255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d06c7-5685-426c-b503-6f0e77f27b5d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.442504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 269/562] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:58.443009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d06c7-5685-426c-b503-6f0e77f27b5d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.506526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b56749-a482-4837-9b82-9004baa8bdea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.509062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.529524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.542443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.543102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.543523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.543803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.554175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:58.559497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:58.560404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:58.561228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 294/563] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:58.561898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.567367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d06c7-5685-426c-b503-6f0e77f27b5d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.604651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9165e7b-52c1-40af-a1d5-615b1ae13f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.605284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165e7b-52c1-40af-a1d5-615b1ae13f21 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.605565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165e7b-52c1-40af-a1d5-615b1ae13f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.605836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9165e7b-52c1-40af-a1d5-615b1ae13f21 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.606672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165e7b-52c1-40af-a1d5-615b1ae13f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:58.606980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165e7b-52c1-40af-a1d5-615b1ae13f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.608489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9165e7b-52c1-40af-a1d5-615b1ae13f21 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.621180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 270/564] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:58.622325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f791a-36fd-4afc-83c4-5b1470072ad1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.622613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f791a-36fd-4afc-83c4-5b1470072ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.622890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f791a-36fd-4afc-83c4-5b1470072ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.640929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b84f791a-36fd-4afc-83c4-5b1470072ad1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:58.642153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b84f791a-36fd-4afc-83c4-5b1470072ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:58.671029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b3872-5437-44cd-8667-f8ab8cc4686b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.707451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.708432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.708713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.708988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.713657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 271/565] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:58.714763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f791a-36fd-4afc-83c4-5b1470072ad1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.720508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.722131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:58.737359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:58.738591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:58.739657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:58.739657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:58.739657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:58.739657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:58.743566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 295/566] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:58.744338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.773024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.780585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:58.839560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f791a-36fd-4afc-83c4-5b1470072ad1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.851616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7101911-ea34-4cfd-9fc5-14dc9cc33cc9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.874534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.875083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.875359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.875628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.876344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:58.876648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.878070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.884954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:58.885597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:58.885874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:58.886174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:58.886407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 272/567] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:58.887178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.893074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:58.894625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:07:58.905943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:58.906829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:58.908081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 296/568] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:58.908593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:58.988970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97727283-3fef-4d51-8863-f6418d748329 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:58.991301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.002990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.009965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec9467-fe1c-4570-8758-d3d88388b014 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.024138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d0fe2-6156-485f-a10c-a354cd9c1b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.024785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0fe2-6156-485f-a10c-a354cd9c1b75 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.025054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0fe2-6156-485f-a10c-a354cd9c1b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.025331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d0fe2-6156-485f-a10c-a354cd9c1b75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.035453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d0fe2-6156-485f-a10c-a354cd9c1b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a41d0fe2-6156-485f-a10c-a354cd9c1b75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:59.040670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:59.041640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:59.042522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 273/569] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:59.043287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.043287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.043440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a771f87-90cd-435e-8e7a-f640b93cf881 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.043509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.043575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a771f87-90cd-435e-8e7a-f640b93cf881 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.043642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.043708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a771f87-90cd-435e-8e7a-f640b93cf881 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.044339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:59.044339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.048854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 274/570] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:07:59.049029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.049151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a771f87-90cd-435e-8e7a-f640b93cf881 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.062535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 297/571] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:59.063221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.147886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a771f87-90cd-435e-8e7a-f640b93cf881 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.163086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc32dd1-3bc1-428d-998c-e48bff8d2a7a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.182680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.183326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.183598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.183868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.194104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.195556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.201069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e941167-95df-4355-b1ae-ce29adadff85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.201697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941167-95df-4355-b1ae-ce29adadff85 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.202079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941167-95df-4355-b1ae-ce29adadff85 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.202358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e941167-95df-4355-b1ae-ce29adadff85 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.203116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941167-95df-4355-b1ae-ce29adadff85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:59.203423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941167-95df-4355-b1ae-ce29adadff85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.204869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e941167-95df-4355-b1ae-ce29adadff85 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:59.210864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:59.211763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:59.213632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:59.213632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:59.213632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:59.213632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:59.213632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 275/572] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:59.213632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.222177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 298/573] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:59.222177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54d469-8394-434a-b2e2-3f260f2757f0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.222177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54d469-8394-434a-b2e2-3f260f2757f0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.222177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54d469-8394-434a-b2e2-3f260f2757f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.236320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5d54d469-8394-434a-b2e2-3f260f2757f0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:07:59.237519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5d54d469-8394-434a-b2e2-3f260f2757f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:07:59.239703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.249255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.307821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 299/574] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:07:59.308730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54d469-8394-434a-b2e2-3f260f2757f0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.330067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6064a-28b8-402f-8f2c-6076f4e9dda7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.364478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.365096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.365354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.365621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.366364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:59.366664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.368038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.375781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 276/575] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:59.376549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.407734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54d469-8394-434a-b2e2-3f260f2757f0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.441245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.441911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.442251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.442528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.449388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.450901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.452995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:07:59.463047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:59.464160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:59.465076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 300/576] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:59.465566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.469158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.484624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c000-5bac-49b6-bcde-1f33f16b2d2a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.523539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.524302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.524603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.524878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.525598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:59.525889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.527309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.540190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 277/577] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:59.540973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.567710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b4b4ea-1bb7-4b6c-b547-f35498376d56 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.601232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.601911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.602228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.602492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/2d0553dc133749eab4777d6552a93178/roles/4cae790876e1492fbe3d3a314f0de80f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.616434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=2d0553dc133749eab4777d6552a93178, role_id=4cae790876e1492fbe3d3a314f0de80f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.617903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.630905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 301/578] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:07:59 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/2d0553dc133749eab4777d6552a93178/roles/4cae790876e1492fbe3d3a314f0de80f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:07:59.631693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.639846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c2fbb-6997-4193-9606-938ba73f1e50 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.681494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.682394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.682765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.683106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.691727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.692971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.698259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:07:59.703458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:59.704666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:07:59.705704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:07:59.710205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 278/579] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:59.711212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.746717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6713a8b-27af-4627-9895-1c918fbc7dc0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.785311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.785311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.785613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.785960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.804147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.805656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.822746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc90a37-9490-49db-b2e3-3befe83a4fd0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:07:59.823900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:59.824752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:59.825625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:07:59.825625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:07:59.825625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:07:59.825625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:59.826385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 302/580] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:59.830172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.859912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.860549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.860822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.861148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.862262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:07:59.862850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.864288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.881971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 279/581] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:07:59.881971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.932417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f63bb-ce09-468e-9809-da3df2de2e7c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:07:59.940054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.947045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:07:59.968527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:07:59.969180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:07:59.969457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:07:59.969729 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:07:59.977587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:07:59.979116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:07:59.990707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:07:59.991700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 303/582] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:07:59.992641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:07:59.999369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a373f-ec7b-4706-be4a-d3d5cf88c8c5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.035185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.035879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.036219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.036559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.037277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:00.037590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.039010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.047940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 280/583] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:00.048722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.107858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac47f9-ef72-4353-836a-ec7ea99f6b8e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.143097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.143814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.144187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.144523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.145280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:00.145639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.147145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.151748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de1d4-767a-4349-a4b3-2003219c406e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.159654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 304/584] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:00.165000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.175361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:00.193041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.193316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:00.194402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.194675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.194940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.195765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=04de0ae1701b4367bf5be9da982bb251) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:00.196064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.197496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.213976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 281/585] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/role_assignments?user.id=04de0ae1701b4367bf5be9da982bb251&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:00.213976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.388315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f3d30-bf3c-4ae3-b49c-9fc32c0ece5b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.395994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbd369-0586-4c5f-a30b-e1371f324e1b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.451988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.452690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.453536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.453871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.458196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.458918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.460140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.460498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.462713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:00.466756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.469952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.479809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.481295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.502085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 305/586] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:00.503442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:00.517527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:00.518459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:00.519460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:00.519460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:00.519460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:00.519460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:00.522251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 282/587] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:00.523076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.561795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:00.627959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df49680-8140-4980-8025-2f3288fc06d3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.665121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.666002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.666178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.666547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.689672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.691219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:00.691357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.717103 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b68043-e0c4-460e-8877-a3c5287c2c3d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:00.724892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:00.725968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:00.726945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:00.726945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:00.726945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:00.726945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:00.729282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 283/588] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:00.730131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.772268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.773082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.773464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.773834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.782593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.784341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:00.798706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:00.799912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:08:00.801863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:00.802915 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 306/589] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:00.809955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.830234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:00.842317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18c63f-8612-48f6-946b-3be7868c672d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.875973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.876600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.876879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.877151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.877909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:00.878404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.879968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.896429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 284/590] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:00.897342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.917526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba78e245-6867-465e-9a6e-c6726f27aac0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:00.954607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:00.955568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:00.956287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:00.956872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:00.957753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:00.958267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:00.960188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:00.973720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 307/591] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:00.974937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:00.978786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:00.997768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5910a-40b3-4c6d-866c-9adbaf780934 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.032003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.032993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.033266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.033535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.034360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:01.034721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.036357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.053661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 285/592] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:01.054604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.063603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:01.089526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafb950-2337-44f0-93fe-d2513cbf45ff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.130666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.131302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.131569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.131891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.141167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.142939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:01.158183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:01.159157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:08:01.160157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:01.162012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 308/593] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:01.162979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.170210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f3509-1733-4d7e-864c-715a7f4fda1e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.211737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.212644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.213470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.213895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.223072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.225071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.236919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:01.240725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:01.241845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:01.242971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:01.245280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 286/594] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:01.246571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.286605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2877a618-7c78-4aa9-94ab-fe59ce91e762 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.330080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.331030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:01.331886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.332400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.332834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.345761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.347574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:01.363842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:01.364990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:01.366082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:01.366082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:01.366082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:01.366082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:01.368121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 309/595] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:01.368672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22d601-7bcb-49d6-a8b1-e064dbbaa9c7 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.369331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.405221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.405702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.406006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.406284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.407089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:01.407756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.409237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.427291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 287/596] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:01.428118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.481133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686f429-e5a6-4388-8f8f-0ca30ed477ad None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.500028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:01.525653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.526800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.527231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.527649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.528693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:01.529183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.530904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.546524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 310/597] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:01.547591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.548491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ec80c-5a93-41d8-8630-dc9bf9944769 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.573667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:01.584494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.585520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.585799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.586115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.586813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:01.587118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.588483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.600562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 288/598] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:01.601362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.658264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72823f6-311c-4f9e-a250-5b92888bd2c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.693956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.694655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.694932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.695200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.701616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbdbcf-b3ab-484f-9eb8-5c3154d178e4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.705325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.706955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:01.721595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:01.722749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:01.723630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:01.723630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:01.723630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:01.723630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:01.723630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 311/599] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:01.723630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.742048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8acfde-66d4-49d1-af25-d42153fc95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.742663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8acfde-66d4-49d1-af25-d42153fc95d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.742943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8acfde-66d4-49d1-af25-d42153fc95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.743216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8acfde-66d4-49d1-af25-d42153fc95d6 None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/b52057428b6444fbbb5d182ab8a2c80a/roles/4cae790876e1492fbe3d3a314f0de80f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.751805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:01.758781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8acfde-66d4-49d1-af25-d42153fc95d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=b52057428b6444fbbb5d182ab8a2c80a, role_id=4cae790876e1492fbe3d3a314f0de80f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.760233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8acfde-66d4-49d1-af25-d42153fc95d6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.781964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 289/600] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:01 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/b52057428b6444fbbb5d182ab8a2c80a/roles/4cae790876e1492fbe3d3a314f0de80f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:01.781964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73292c3-0c24-4eca-bdbb-bab426892281 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.781964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73292c3-0c24-4eca-bdbb-bab426892281 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.781964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73292c3-0c24-4eca-bdbb-bab426892281 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.781964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 290/601] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:01.783536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73292c3-0c24-4eca-bdbb-bab426892281 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:01.836720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde72b29-7bcb-4cf5-b3c6-f32a1f35ec77 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.845685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:01.878724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d205-babc-436a-9658-3c94521692b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.879714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d205-babc-436a-9658-3c94521692b6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.880207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d205-babc-436a-9658-3c94521692b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.880648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d205-babc-436a-9658-3c94521692b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.888797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d205-babc-436a-9658-3c94521692b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.890643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d205-babc-436a-9658-3c94521692b6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a5d4d205-babc-436a-9658-3c94521692b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:01.903766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:01.904732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:01.905607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:01.908252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 312/602] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:01.909874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e09d1-7e37-40ba-8406-c84a6b946429 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.910392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e09d1-7e37-40ba-8406-c84a6b946429 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.910879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e09d1-7e37-40ba-8406-c84a6b946429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.928031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73292c3-0c24-4eca-bdbb-bab426892281 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:01.930814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-986e09d1-7e37-40ba-8406-c84a6b946429 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:01.932283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-986e09d1-7e37-40ba-8406-c84a6b946429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:01.977305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:01.977970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:01.978249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:01.978526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:01.979229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:01.979534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:01.981318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:01.996447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 291/603] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:01.997217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.014246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 313/604] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:02.015093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e09d1-7e37-40ba-8406-c84a6b946429 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.036478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:02.126465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:02.137547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286183a-076a-4d1c-b8ef-89f44d4d8278 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:02.141328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e09d1-7e37-40ba-8406-c84a6b946429 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:02.177890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:02.178738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.179119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.179520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.185484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:02.186582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.187029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.187157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:02.187557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.188446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:02.188894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:02.189158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:02.191171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:02.201205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:02.202330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:02.203363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:02.208182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 292/606] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:02.209206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 314/606] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:02.209693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.210401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.299567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:02.323220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efeb2dd-c8f1-42a0-b6e0-4e6b3698a18e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:02.328831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e11f2-dc6b-4f7a-987f-b155d19395cd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:02.356797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:02.357426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.357709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.358008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.358786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:02.359101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:02.360555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:02.370759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ee018-601c-4733-8cb3-9a4d9e591d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:02.371591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee018-601c-4733-8cb3-9a4d9e591d3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.372033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee018-601c-4733-8cb3-9a4d9e591d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.372154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 315/607] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:02.372540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ee018-601c-4733-8cb3-9a4d9e591d3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.372838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.387545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ee018-601c-4733-8cb3-9a4d9e591d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d36ee018-601c-4733-8cb3-9a4d9e591d3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:02.392301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:02.393234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:02.394621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 293/608] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:02.395321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735915f3-9951-499a-845a-0a5165a3a628 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.395321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735915f3-9951-499a-845a-0a5165a3a628 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.395321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735915f3-9951-499a-845a-0a5165a3a628 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.396605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 294/609] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:02.397125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735915f3-9951-499a-845a-0a5165a3a628 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.414608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:02.491633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74265fd2-007b-416f-afb4-60b26236bf0d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:02.523251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735915f3-9951-499a-845a-0a5165a3a628 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:02.526805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:02.527482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.527773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.528040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/0131e4a3492c42c492c47a715a2bccaf/roles/4cae790876e1492fbe3d3a314f0de80f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.537331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:02.545858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=0131e4a3492c42c492c47a715a2bccaf, role_id=4cae790876e1492fbe3d3a314f0de80f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:02.547438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:02.560007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2df1-05a1-48c5-af28-d8a46818f926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:02.560611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2df1-05a1-48c5-af28-d8a46818f926 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.560884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2df1-05a1-48c5-af28-d8a46818f926 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.561440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2df1-05a1-48c5-af28-d8a46818f926 None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/ed70b6997f064f3f8fa68dea2a6eb470/roles/4cae790876e1492fbe3d3a314f0de80f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.570323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 316/610] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:02 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/0131e4a3492c42c492c47a715a2bccaf/roles/4cae790876e1492fbe3d3a314f0de80f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:02.570323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.587604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff2df1-05a1-48c5-af28-d8a46818f926 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=ed70b6997f064f3f8fa68dea2a6eb470, role_id=4cae790876e1492fbe3d3a314f0de80f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:02.589382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff2df1-05a1-48c5-af28-d8a46818f926 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:02.606332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 295/611] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:02 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/ed70b6997f064f3f8fa68dea2a6eb470/roles/4cae790876e1492fbe3d3a314f0de80f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:02.612057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e849-1fcd-40cb-bc0d-5856a68683c2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.612365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e849-1fcd-40cb-bc0d-5856a68683c2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.612785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20e849-1fcd-40cb-bc0d-5856a68683c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.658947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cd20e849-1fcd-40cb-bc0d-5856a68683c2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:02.661074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cd20e849-1fcd-40cb-bc0d-5856a68683c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:02.754746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41548df1-1ee9-4b30-b531-6e6ad611699e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:02.793011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:02.807018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:02.807666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:02.807949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:02.808154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:02.808889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:02.809299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:02.810928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:02.813739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 296/612] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:02.820378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 317/613] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:02.825723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e849-1fcd-40cb-bc0d-5856a68683c2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.846717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:02.927606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:02.995190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268985-b7ec-4ef0-8b49-2c1b383c26e8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.018628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20e849-1fcd-40cb-bc0d-5856a68683c2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.061452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.062065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.062356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.062627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.074386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:03.075859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:03.077973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.078683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.078970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.079247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:03.102076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:03.103027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:03.104329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:03.104329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:03.104329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:03.104329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:03.104329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 297/614] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:03.104798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:03.108940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:03.111343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:03.112251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:03.113552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 318/615] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:03.120356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.211269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:03.292115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfc74-d16d-4848-a796-8444ec566c8f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.303998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc757a6-357c-445c-bbbc-77bf2e801d3a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.327549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:03.348206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.349052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.349243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.349506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.350261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:03.350570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:03.352021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:03.365116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 298/616] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:03.370388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.384267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.384903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.385180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.385450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.386207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:03.386524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:03.387924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:03.403877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 319/617] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:03.410573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.549795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d6aa1-c435-4f2e-b65d-e94a1b0de70c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.573712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d23e1-c77b-4046-acc4-2fe2bf6bd54c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.586160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:03.590381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.591368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.591832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.592320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.613226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:03.616036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:03.637858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:03.638944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:03.639865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:03.639865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:03.639865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:03.639865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:03.644134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.644999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.645465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.645882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.647608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 320/618] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:03.653976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.663194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:03.664883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:03.682641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:03.688275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:03.689238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:03.690211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:03.692984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 299/619] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:03.698659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.781835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440860-f2c4-40f5-9f90-07638f75225d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.839758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.840312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.840593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.840865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.841568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:03.841686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13825341-4bb3-4a21-841d-94d3c43dac3f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:03.841868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:03.843287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:03.870582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 321/620] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:03.876233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.879214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:03.879852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:03.880130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:03.880410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:03.881216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:03.881520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:03.882993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:03.902125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 300/621] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:03.908224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:03.941898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.028779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.045694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4883b-9200-454b-b0a8-fb1bb71d9bab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.053537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fce46e-9961-4c96-99b8-18230b00a862 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.090405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b5bcf-fbe5-44b9-8267-bed2f203abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.090956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b5bcf-fbe5-44b9-8267-bed2f203abda None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.091233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b5bcf-fbe5-44b9-8267-bed2f203abda None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.091508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b5bcf-fbe5-44b9-8267-bed2f203abda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.110146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.110794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.111075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.111349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.126320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.127808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:04.155953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:04.156935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:04.159522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 322/622] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:04.167259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.234165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b5bcf-fbe5-44b9-8267-bed2f203abda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.235742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b5bcf-fbe5-44b9-8267-bed2f203abda None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:04.262000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.297835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e17a0-7ba1-479d-ae8a-f069cb100908 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.339744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.340681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.341035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.341301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.342562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:04.342876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.344326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:04.367102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 301/623] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:08:04.368753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995e65-a0a3-4e78-96f0-bbb108b03c17 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.369241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995e65-a0a3-4e78-96f0-bbb108b03c17 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.369723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c995e65-a0a3-4e78-96f0-bbb108b03c17 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.371081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 323/624] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:04.371678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 302/625] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:04.375923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.377815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.379109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995e65-a0a3-4e78-96f0-bbb108b03c17 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.507787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a84bfc-b02e-4cb6-a3e5-77421f2f9466 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.523072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c995e65-a0a3-4e78-96f0-bbb108b03c17 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.551357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fadd7-4e73-466c-a28e-84372375ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.552109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fadd7-4e73-466c-a28e-84372375ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.552474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fadd7-4e73-466c-a28e-84372375ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.552807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fadd7-4e73-466c-a28e-84372375ccc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.556252 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.568306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fadd7-4e73-466c-a28e-84372375ccc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.569977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fadd7-4e73-466c-a28e-84372375ccc8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:04.571347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.572437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.573284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.573748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a45fadd7-4e73-466c-a28e-84372375ccc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:04.586510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:04.587440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:04.588332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:04.588332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:04.588332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:04.588332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:04.589871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.590839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 324/626] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:04.591553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:04.592631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e335d-611f-467d-8714-be314e84a846 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.593134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e335d-611f-467d-8714-be314e84a846 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.593611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e335d-611f-467d-8714-be314e84a846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.612135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-998e335d-611f-467d-8714-be314e84a846 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:04.613700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:04.614727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:04.615660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:04.615660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:04.615660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:04.615660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:04.615660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 303/627] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:04.616336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.616622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-998e335d-611f-467d-8714-be314e84a846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:04.669142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.688797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 325/628] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:04.689972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e335d-611f-467d-8714-be314e84a846 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.741015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae60cb-0d1c-4cfe-82e0-b2ced449ab3f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.775508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.776124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.776511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.776714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.777452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:04.777765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.779194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:04.793996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e335d-611f-467d-8714-be314e84a846 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.797349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 304/629] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:04.798032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.830095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.831171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.831643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.832096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.832974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:04.833484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.834971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:04.835419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.846710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 326/630] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:04.847548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.892727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:04.904729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c71cda-c4de-4d06-a5ad-f06a70fc708e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.938216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584a579-3ce3-4cc2-b174-c9096889a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.938853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584a579-3ce3-4cc2-b174-c9096889a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.939128 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584a579-3ce3-4cc2-b174-c9096889a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.939397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584a579-3ce3-4cc2-b174-c9096889a3d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.945722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105da25-8746-43fb-928e-43111e23e42f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:04.949395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584a579-3ce3-4cc2-b174-c9096889a3d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-b584a579-3ce3-4cc2-b174-c9096889a3d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:04.954193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:04.955209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:04.956043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 305/631] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:04.956836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59590e21-659c-4fc1-94d4-6ab03adf01a0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.956836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59590e21-659c-4fc1-94d4-6ab03adf01a0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.957413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59590e21-659c-4fc1-94d4-6ab03adf01a0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.958348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 306/632] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:04.959029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59590e21-659c-4fc1-94d4-6ab03adf01a0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:04.980639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda1ef4-6d12-4f95-ba0a-e25574d00fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:04.981278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1ef4-6d12-4f95-ba0a-e25574d00fec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:04.981554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1ef4-6d12-4f95-ba0a-e25574d00fec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:04.981829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda1ef4-6d12-4f95-ba0a-e25574d00fec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:04.988716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda1ef4-6d12-4f95-ba0a-e25574d00fec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:04.990217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda1ef4-6d12-4f95-ba0a-e25574d00fec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-5fda1ef4-6d12-4f95-ba0a-e25574d00fec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:05.001370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:05.002348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:05.003278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 327/633] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:05.003854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125349-f20e-488e-9e19-f21fbaabb567 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.003854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125349-f20e-488e-9e19-f21fbaabb567 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.004237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125349-f20e-488e-9e19-f21fbaabb567 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.005332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 328/634] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:05.006073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b125349-f20e-488e-9e19-f21fbaabb567 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.058902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.065757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59590e21-659c-4fc1-94d4-6ab03adf01a0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.098985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64791e5e-8f6c-400f-a30c-ff972b93698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.099502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64791e5e-8f6c-400f-a30c-ff972b93698e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.099774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64791e5e-8f6c-400f-a30c-ff972b93698e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.100046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64791e5e-8f6c-400f-a30c-ff972b93698e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.106521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64791e5e-8f6c-400f-a30c-ff972b93698e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:05.107021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b125349-f20e-488e-9e19-f21fbaabb567 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.107947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64791e5e-8f6c-400f-a30c-ff972b93698e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.109303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-64791e5e-8f6c-400f-a30c-ff972b93698e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:05.119117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:05.120051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:05.120986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:05.124906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 307/635] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:05.126147 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff6435-037c-40a0-846e-6e1ebda2a5e6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.126432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff6435-037c-40a0-846e-6e1ebda2a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.126703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff6435-037c-40a0-846e-6e1ebda2a5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.142898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.143527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.143872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.144146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.144521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-73ff6435-037c-40a0-846e-6e1ebda2a5e6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:05.144862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:05.145166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:05.145706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-73ff6435-037c-40a0-846e-6e1ebda2a5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:05.146585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.154442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 329/636] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:05.155276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.216865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 308/637] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:05.218228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f66eb-1eaa-47f0-9b9f-0ef16aa7a87e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.218509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f66eb-1eaa-47f0-9b9f-0ef16aa7a87e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.218779 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f66eb-1eaa-47f0-9b9f-0ef16aa7a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.235494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a72f66eb-1eaa-47f0-9b9f-0ef16aa7a87e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:05.236673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a72f66eb-1eaa-47f0-9b9f-0ef16aa7a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:05.250851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936df43-769a-4471-ae28-970af0dc5ad0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.283401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.284016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.284347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.284618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.285360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:05.285663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:05.287137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.299013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 330/638] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:05.299771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.302673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 309/639] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:05.303501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f66eb-1eaa-47f0-9b9f-0ef16aa7a87e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.328462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.330305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.403452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e78c2a-7dba-41c1-9cb7-52c3e52a476d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.415562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f66eb-1eaa-47f0-9b9f-0ef16aa7a87e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.437407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.438061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.438323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.438596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.439343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:05.439649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:05.441134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.448254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.448893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.449171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.449467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.452502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 331/640] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:05.453391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.461394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:05.462878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:05.478474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:05.479502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:05.480398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:05.480398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:05.480398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:05.480398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:05.480398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 310/641] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:05.480398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.545088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.549025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.561648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36358c0b-1bd3-42ed-aac8-134e0b632243 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.583609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf29bb-72b0-4f01-8c45-8b62eb47b28a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.594753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.595396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.595678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.595955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.605876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:05.611161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:05.612316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 332/642] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:05.613372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.620077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.620707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.620992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.621275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.622108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=2d0553dc133749eab4777d6552a93178) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:05.622421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:05.623868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.629972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 311/643] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/role_assignments?user.id=2d0553dc133749eab4777d6552a93178&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:05.630727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.743590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d249b-3247-4428-9432-d3e72233f31d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.749735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13ec36-0d9c-4c1c-a191-bd05753e51e1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.784387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.785644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.786367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.786733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.787072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.791525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.792391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:05.792674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:05.792956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/04de0ae1701b4367bf5be9da982bb251/roles/4cae790876e1492fbe3d3a314f0de80f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:05.800515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:05.806026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:05.807133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 333/644] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:05.808306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.811640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=04de0ae1701b4367bf5be9da982bb251, role_id=4cae790876e1492fbe3d3a314f0de80f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:05.814209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:05.818266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:05.829013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 312/645] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:05 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/04de0ae1701b4367bf5be9da982bb251/roles/4cae790876e1492fbe3d3a314f0de80f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:05.834867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:05.936866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4ff17-4aa7-4682-a4fe-b571fe41cc0b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.959640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89992a8-e462-40e0-9c1e-5d0ae058049a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:05.997579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:05.999819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.000750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.001146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.002650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:06.003210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.005437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.006067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.006761 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.007048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.007319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.008049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:06.008355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.009975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.021319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 313/646] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:06.022315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.025209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 334/647] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:06.027123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.078117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.116874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.148200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e99d-fcd1-4653-99f3-d605c26b42a2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.161065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061222b9-35fe-472a-8965-aeab60e9ad59 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.193882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.195376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.195841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.196506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.197621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:06.198164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.200563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.203923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.204686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.205065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.205446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.211694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 314/648] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:06.212781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.219118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.220745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:06.241076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:06.242113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:06.243132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:06.243132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:06.243132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:06.243132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:06.243132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 335/649] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:06.244065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.348668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c849112-b838-4ded-bcc2-d03a9eff0da2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.356784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.375901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2644a7-a48e-4bc8-8114-d18e87d2aa91 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.386076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.386669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.387150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.387501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.395290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.395491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.396991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:06.410210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:06.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:08:06.412528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:06.413956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 315/650] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:06.421889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.425355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.426625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.427097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.427526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.439309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.441085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:06.456374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:06.457288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:06.458205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:06.458205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:06.458205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:06.458205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:06.460274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 336/651] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:06.461275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.520913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388558a4-1775-4d0b-9d68-3b6b3ad4c70d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.556075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.556881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.557258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.557635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.558468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:06.558874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.560370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.572947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 316/652] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:06.573921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.581676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2d472-e91d-42cf-a717-6cfc056a9c19 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.602184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.628426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.629433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.629983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.630545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.631696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:06.632202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.633879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.658304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 337/653] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:06.659677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.682021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621cae5-9a95-4bae-a286-1e1d98411e06 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.690618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.717100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.717728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.718035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.718311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.719007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:06.719314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.720829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.732748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 317/654] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:06.733669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.771890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18ea53-4c8c-4fe3-b496-ca6036765603 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.809190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.810355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.810839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.811352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.819561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.820309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.822613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.836167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f321b67-96b4-4662-abae-1b1908355c33 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:06.837294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:06.838264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 06 01:08:06.839197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:06.841835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 338/655] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:06.842960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:06.871089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.871642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.871921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.872195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:06.943119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:06.944231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:06.945771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:06.957596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ba819-b6cc-4ae0-99bd-9ac011507430 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:06.994696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:06.995826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:06.996365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:06.996846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.006451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.008326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:07.022264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:07.023329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 06 01:08:07.024291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:07.027099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 339/656] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:07.028257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.035275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.055922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 318/657] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:08:07.055922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.143153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc87aa8-4d02-4d90-90b6-c241cbfd285c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.152317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6339e-9b4f-4ec0-ab17-c38da3974a98 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.181071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:07.182079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.182615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.183259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.184253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:07.184767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.186967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.188616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:07.189307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.189523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.189844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.190704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:07.191009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.192436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.208251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 340/658] 10.222.0.17 () {56 vars in 1137 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:07.209493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.211540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 319/659] 10.222.0.17 () {56 vars in 1139 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:07.213272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.219199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.323378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc2496-70d8-4fb6-b0d6-1ff505428540 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.363622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:07.364578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.365002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.365432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.377255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.379095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.388114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:07.398836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:07.399771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:07.400651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:07.400651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:07.400651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:07.400651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:07.407691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 341/660] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:07.408779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.446169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ebdc5-922a-4702-ae0e-9b2f939bb1f8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.473314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.481521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:07.482317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.482669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.483009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.531689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562ac7a-9b74-44de-a0f0-d64109c86826 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.558211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.559921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.569196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:07.570128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.570628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.571121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.608309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.654862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.656757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.672945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 320/661] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:08:07.674212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.736624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.782979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 342/662] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:08:07.783832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.797342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b52749-0cb3-4860-a241-6a4fb2ae2e90 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.833296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196db85c-84b8-40f0-931d-73efa82de5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:07.833985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db85c-84b8-40f0-931d-73efa82de5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.834297 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db85c-84b8-40f0-931d-73efa82de5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.834543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196db85c-84b8-40f0-931d-73efa82de5c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.835270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196db85c-84b8-40f0-931d-73efa82de5c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:07.835578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196db85c-84b8-40f0-931d-73efa82de5c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.836928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196db85c-84b8-40f0-931d-73efa82de5c1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.848968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 321/663] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:07.850046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d154a32-ef68-42c7-b999-920c74ce5d1d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.850322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d154a32-ef68-42c7-b999-920c74ce5d1d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.850590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d154a32-ef68-42c7-b999-920c74ce5d1d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.856052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 322/664] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:07.856052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d154a32-ef68-42c7-b999-920c74ce5d1d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.859052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.897793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627eb26-2b56-4aac-93fd-8f7f74590df7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.932814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:07.933467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:07.933748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:07.934058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:07.944435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:07.945912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:07.960084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d154a32-ef68-42c7-b999-920c74ce5d1d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:07.961054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:07.961980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:07.962878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:07.962878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:07.962878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:07.962878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:07.962878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 343/665] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:07.963189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:07.975048 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:07.999569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8659d-225f-4cf7-a48c-9db0880e4783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.000212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8659d-225f-4cf7-a48c-9db0880e4783 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.000491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8659d-225f-4cf7-a48c-9db0880e4783 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.000755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8659d-225f-4cf7-a48c-9db0880e4783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.011134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8659d-225f-4cf7-a48c-9db0880e4783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.012591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8659d-225f-4cf7-a48c-9db0880e4783 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-74b8659d-225f-4cf7-a48c-9db0880e4783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:08.027075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:08.027984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:08.028852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:08.028852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:08.028852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:08.028852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:08.028852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 323/666] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:08.029512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be2a3-3fef-42e3-93f8-c1c7fa42c3af None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.029778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be2a3-3fef-42e3-93f8-c1c7fa42c3af None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.030084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283be2a3-3fef-42e3-93f8-c1c7fa42c3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.047601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-283be2a3-3fef-42e3-93f8-c1c7fa42c3af None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:08.048799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-283be2a3-3fef-42e3-93f8-c1c7fa42c3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:08.064429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb8106-fd64-4d13-9f4a-b6ab35c12458 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.096929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.097576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.097858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.098132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.098370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.104835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.106353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.117586 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 324/667] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:08.118165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:08.119003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:08.119897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:08.120313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629a29-6a8a-425a-960a-bce5b33e3852 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.120313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629a29-6a8a-425a-960a-bce5b33e3852 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.120313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b629a29-6a8a-425a-960a-bce5b33e3852 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.120488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 344/668] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:08.120488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.121163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 325/669] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:08.121574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b629a29-6a8a-425a-960a-bce5b33e3852 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.192450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.224156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0188d-6b1a-4861-8ab8-f23b9ea34af0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.241667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b629a29-6a8a-425a-960a-bce5b33e3852 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.257094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf6c8e-7c68-4ed1-a377-7851d247910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.257714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6c8e-7c68-4ed1-a377-7851d247910c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.258032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6c8e-7c68-4ed1-a377-7851d247910c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.258310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6c8e-7c68-4ed1-a377-7851d247910c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.259010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf6c8e-7c68-4ed1-a377-7851d247910c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:08.259317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf6c8e-7c68-4ed1-a377-7851d247910c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.260714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf6c8e-7c68-4ed1-a377-7851d247910c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.272300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 345/670] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:08.273429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1afc-ee7a-479e-a8e7-cd1c6aea70ce None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.273768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1afc-ee7a-479e-a8e7-cd1c6aea70ce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.274080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc1afc-ee7a-479e-a8e7-cd1c6aea70ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.275758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.276443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.276724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.277013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.277681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:08.278028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.279401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.291230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 326/671] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:08.291674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3ecc1afc-ee7a-479e-a8e7-cd1c6aea70ce None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:08.292022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.292866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3ecc1afc-ee7a-479e-a8e7-cd1c6aea70ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:08.340055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.357811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 346/672] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:08.358671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc1afc-ee7a-479e-a8e7-cd1c6aea70ce None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.402669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71da6c-6a69-46f4-8912-75f605d6c4f1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.416094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.436788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.437400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.437693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.437981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.438732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:08.439042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.440550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.452290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 327/673] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:08.453016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.459983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc1afc-ee7a-479e-a8e7-cd1c6aea70ce None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.493907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.494589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.494868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.495139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.506493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:08.511361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:08.512262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:08.513107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 347/674] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:08.514109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.558500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7262-5974-43df-92d0-b94918268f5b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.566452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.592653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.593308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.593583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.593851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.600437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.601883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.609842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e1cc-aa37-4214-8bc8-b69959a79d72 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:08.613208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:08.614295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:08.615371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 328/675] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:08.615941 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.633021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.647974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.648622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.648911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.649196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.655767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.657608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:08.668726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:08.669789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:08.670898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 348/676] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:08.671506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.714803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82efa96e-06d0-45fb-971f-9f5e39d05c41 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.749728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.750438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.750712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.750954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.760934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:08.766176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:08.767230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 329/677] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:08.768105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.768935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07127e-2d91-44ea-89c7-04aaaaa89cf3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.799217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.803295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.803927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.804209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.804485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.805284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=b52057428b6444fbbb5d182ab8a2c80a) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:08.805593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.807096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.813091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 349/678] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/role_assignments?user.id=b52057428b6444fbbb5d182ab8a2c80a&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:08.813838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.866036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:08.879183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4129b62-1d5e-43e5-ac04-4e9ad26e887b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.916699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.917337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.917615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.917883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.918643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:08.918959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.920341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.929223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 330/679] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:08.930125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:08.930965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48253bb6-8df7-4c25-94c6-4e9308a24e7c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:08.980914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:08.981585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:08.981957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:08.982237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:08.983027 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:08.983340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:08.984803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:08.998176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 350/680] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:08.999002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.051440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:09.065203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9816d5f-f45f-4fcd-aa0d-ca5f4df12927 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.101366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.102059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.102341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.102613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.103368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:09.103674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.105111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.113923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc1c253-6a78-4254-a6a7-0b56bc3912de None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.117021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:09.122366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 331/681] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:09.122366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.152562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.153186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.153464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.153730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.154493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:09.154810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.156233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.164863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 351/682] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:09.165655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.225345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60756054-d3c7-4d18-9ed2-ea14123c6859 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.261543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.262524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.263016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.263363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.269020 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeaca9-d75a-4e95-ab50-7c72cd04bc4d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.274485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.276015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.286295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:09.293071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:09.294246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:09.295434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:09.295434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:09.295434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:09.295434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:09.295887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 332/683] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:09.296615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.309433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.310092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.310371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.310650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.311798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=0131e4a3492c42c492c47a715a2bccaf) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:09.311798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.313169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.319296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 352/684] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/role_assignments?user.id=0131e4a3492c42c492c47a715a2bccaf&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:09.320061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.370448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:09.436062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb256-fc57-4c9c-b38f-bc72a502458c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.472327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac16da-276b-40eb-8b87-2580e072590f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.484064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.485221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.485659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.486219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.487037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=ed70b6997f064f3f8fa68dea2a6eb470) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:09.488534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.489912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.497730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 333/685] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/role_assignments?user.id=ed70b6997f064f3f8fa68dea2a6eb470&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:09.503456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.520283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.521035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.521744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.521744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.537072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.538669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:09.558427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:09.559402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:09.560296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:09.560296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:09.560296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:09.560296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:09.560968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 353/686] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:09.566458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.597540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:09.646385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d56b75-7e62-419e-b72f-750112594644 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.661280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:09.683801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec125b-40bb-4270-8cd1-c9f202b02fe0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.689604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.690693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.691235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.691735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.692890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:09.693428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.695196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.709730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 334/687] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:09.716043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.720883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.721561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.721847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.722154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.722864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:09.723168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.724586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.742161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 354/688] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:09.743612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.841169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e97599-3426-454e-8fd4-9206316f6c64 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.866358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7b908-9c4c-4dfe-8dd6-f75fc54d9ec0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:09.876046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:09.880465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.881233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.881531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.881854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.890196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.891785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:09.904877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:09.905870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:09.907257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 335/689] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:09.911128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:09.912050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:09.912572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.912682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:09.913256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:09.921761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:09.923763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:09.937210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:09.938303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:09.939234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:09.942149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 355/690] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:09.950898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:09.954855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:10.096780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8d103-ac99-4fb1-8058-21ca0c372742 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:10.131293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688476a-b27a-4704-a55a-221fc93813cc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:10.139374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:10.140005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:10.140285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:10.140551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:10.141360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:10.141661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:10.143129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:10.174520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 336/691] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:10.182896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:10.207294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:10.207949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:10.208239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:10.208507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:10.209317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:10.209625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:10.211259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:10.241144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 356/692] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 01:08:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:10.246885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:10.258975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:10.302377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e235bf-e59c-4f13-8ecd-93819df7bc88 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:10.340708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:10.341363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:10.341644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:10.341987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:10.403051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:10.418212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:10.419689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:10.465923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:10.489226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce07a30-a5aa-4ac1-a0e9-480f876f17b1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:10.535253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:10.535897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:10.536213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:10.536500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:10.611014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:10.612627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:10.639494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 337/693] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 06 01:08:10.645244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:10.703728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:10.745576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 357/694] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 06 01:08:10.752105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:10.872330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c193a-0489-4235-bbaf-953dbe8636cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:10.900735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab51b4e-f8d7-4fac-8546-fa60067d0516 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:10.917093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:10.918100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:10.918617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:10.919088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:10.933711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:10.939714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:10.964709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:10.965654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:10.966591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:10.966591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:10.966591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:10.966591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:10.973884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:10.978374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:10.978888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:10.979379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:10.979888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 358/695] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:10.993875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:10.995409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.002797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.007909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:11.027922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:11.028851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:11.029774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:11.029774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:11.029774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:11.029774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:11.029774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 338/696] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:11.036879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.039303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.127003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85856b7-ed3d-42ab-83e7-3e9106ca56fb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.156099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a248-737f-433a-a12a-a4d4a67d9397 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.163379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5dd5b-a520-4bbd-91bc-bdce60fa6235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.164283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5dd5b-a520-4bbd-91bc-bdce60fa6235 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.164778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5dd5b-a520-4bbd-91bc-bdce60fa6235 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.165262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5dd5b-a520-4bbd-91bc-bdce60fa6235 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.166186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5dd5b-a520-4bbd-91bc-bdce60fa6235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:11.166692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5dd5b-a520-4bbd-91bc-bdce60fa6235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.168401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5dd5b-a520-4bbd-91bc-bdce60fa6235 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.181222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 359/697] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:11.187088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d795f0-079b-48ef-a80a-b4f120b544d9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.187601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d795f0-079b-48ef-a80a-b4f120b544d9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.188128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d795f0-079b-48ef-a80a-b4f120b544d9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.190169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 360/698] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:11.191179 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d795f0-079b-48ef-a80a-b4f120b544d9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.196159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186067b-bb4a-4e0d-8e5b-5765554c6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.196395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186067b-bb4a-4e0d-8e5b-5765554c6ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.196626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186067b-bb4a-4e0d-8e5b-5765554c6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.196902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186067b-bb4a-4e0d-8e5b-5765554c6ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.197598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186067b-bb4a-4e0d-8e5b-5765554c6ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:11.197905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186067b-bb4a-4e0d-8e5b-5765554c6ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.199316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186067b-bb4a-4e0d-8e5b-5765554c6ff8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.216790 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 339/699] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:11.218055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61db4a-60b0-475b-b253-65ec118bdfb2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.218411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61db4a-60b0-475b-b253-65ec118bdfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.218679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61db4a-60b0-475b-b253-65ec118bdfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.236901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fa61db4a-60b0-475b-b253-65ec118bdfb2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:11.238194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fa61db4a-60b0-475b-b253-65ec118bdfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:11.270664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.291276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.306133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d795f0-079b-48ef-a80a-b4f120b544d9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.317766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 340/700] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:11.318801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61db4a-60b0-475b-b253-65ec118bdfb2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.343904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.344959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.345442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.345914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.353459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.355308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:11.367663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:11.368710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:11.369677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:11.372120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 361/701] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:11.373101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.448360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61db4a-60b0-475b-b253-65ec118bdfb2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.482547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70996960-eb44-45c0-8eb0-ee54ef78b932 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.483727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.484384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.484659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.484930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.492274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.493735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:11.513803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:11.514760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:11.515698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:11.519853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 341/702] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:11.520725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.521205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.528925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.529871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.530411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.530933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.532129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.533895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:11.546300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:11.547747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:11.548629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:11.551543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 362/703] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:11.552549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.575290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.632087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f74b1e-1d5b-4a0f-bf14-702ad4dfc14c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.660997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40697e31-b976-414a-a251-ea7486ebe460 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.667490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.668130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.668409 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.668682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.669440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:11.669745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.671238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.690400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 342/704] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:11.691512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.814702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24646f-a814-44c8-b96d-c2f193db0112 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.817991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.829007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.829606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.829881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.830185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.831012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:11.831309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.832755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.845325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 363/705] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:11.846145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.858377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda73fa6-b073-4f00-b835-e6c61cd3f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.859028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73fa6-b073-4f00-b835-e6c61cd3f23b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.859309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73fa6-b073-4f00-b835-e6c61cd3f23b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.859581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda73fa6-b073-4f00-b835-e6c61cd3f23b None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.860258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda73fa6-b073-4f00-b835-e6c61cd3f23b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:11.860637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda73fa6-b073-4f00-b835-e6c61cd3f23b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.862048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda73fa6-b073-4f00-b835-e6c61cd3f23b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.871190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 343/706] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:11.871190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810fab0-337d-4d27-b457-2b8889c3ab1f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.871190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810fab0-337d-4d27-b457-2b8889c3ab1f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.871190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810fab0-337d-4d27-b457-2b8889c3ab1f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.871190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 344/707] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:11.871190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810fab0-337d-4d27-b457-2b8889c3ab1f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:11.910116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:11.954090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1fd4de-036e-4d75-95d9-0ec9d7c30db9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.972718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810fab0-337d-4d27-b457-2b8889c3ab1f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:11.987441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:11.988054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:11.988330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:11.988600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:11.989392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=04de0ae1701b4367bf5be9da982bb251) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:11.989699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:11.991193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:11.996777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 364/708] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/role_assignments?user.id=04de0ae1701b4367bf5be9da982bb251&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:11.997549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:12.007940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43b37c-0de0-435d-9da7-c1eae9c332fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.010202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43b37c-0de0-435d-9da7-c1eae9c332fa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.010202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43b37c-0de0-435d-9da7-c1eae9c332fa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.010202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43b37c-0de0-435d-9da7-c1eae9c332fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.010202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43b37c-0de0-435d-9da7-c1eae9c332fa None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=2d0553dc133749eab4777d6552a93178) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:12.010620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43b37c-0de0-435d-9da7-c1eae9c332fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.012005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43b37c-0de0-435d-9da7-c1eae9c332fa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.029982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 345/709] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/role_assignments?user.id=2d0553dc133749eab4777d6552a93178&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:12.029982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758faa-62a5-48e6-a572-300aabe74028 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.029982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758faa-62a5-48e6-a572-300aabe74028 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.029982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758faa-62a5-48e6-a572-300aabe74028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.046255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2b758faa-62a5-48e6-a572-300aabe74028 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:12.047727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2b758faa-62a5-48e6-a572-300aabe74028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:12.080715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:12.139216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 346/710] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:12.140990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf17349-72c1-4132-83d8-61cb7d482b03 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.141305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf17349-72c1-4132-83d8-61cb7d482b03 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.141668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf17349-72c1-4132-83d8-61cb7d482b03 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.147450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 347/711] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:12.149407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b5ed-4ad9-4c84-a052-c601811f07ae None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.149786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b5ed-4ad9-4c84-a052-c601811f07ae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.150209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7b5ed-4ad9-4c84-a052-c601811f07ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.156126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639b806-e981-469b-a794-ff182159b0a2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:12.170481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0ed7b5ed-4ad9-4c84-a052-c601811f07ae None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:12.172133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0ed7b5ed-4ad9-4c84-a052-c601811f07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:12.186430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:12.210060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.211059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.211522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.211974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.212921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:12.213561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.215330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.222555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 365/712] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 01:08:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:12.223661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:12.262183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 348/713] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:12.282167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b5ed-4ad9-4c84-a052-c601811f07ae None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:12.351193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5729e62-739f-4199-bd17-31fefc7969c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:12.392985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.394151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.394587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.395270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.409509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:12.411354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.413296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.420442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7b5ed-4ad9-4c84-a052-c601811f07ae None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:12.431955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:12.433081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:12.434053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:12.434053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:12.434053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:12.434053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:12.436556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 366/714] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:12.442075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:12.469394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.470283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.470887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.471169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] PATH_INFO: `/v3/services/network` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.472119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.474018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.480355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:12.487830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:12.489246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:12.490394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 349/715] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:12 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:12.497075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:12.587943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d832e-981b-4f54-81da-ad60bf172153 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:12.616102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17e1ce-5486-4ff5-bbf9-c89a2fc8114c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:12.651933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.652841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.653256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.653671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.654552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:12.654664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd306-fa65-4204-912a-f21280016506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.655102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.655287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd306-fa65-4204-912a-f21280016506 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.655570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd306-fa65-4204-912a-f21280016506 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.655837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dd306-fa65-4204-912a-f21280016506 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.656534 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd306-fa65-4204-912a-f21280016506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:12.657195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd306-fa65-4204-912a-f21280016506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.657741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.658593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393dd306-fa65-4204-912a-f21280016506 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.663214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 350/716] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:12.668813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:12.682755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 367/717] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:12.688152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd306-fa65-4204-912a-f21280016506 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:12.694798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:12.775021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3ae09-1e90-4fdb-a49c-e16c2ab7a9f9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:12.812940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e094c-d381-4ace-9168-5446aa51963d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.813568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e094c-d381-4ace-9168-5446aa51963d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.813851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e094c-d381-4ace-9168-5446aa51963d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.814182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e094c-d381-4ace-9168-5446aa51963d None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.814871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e094c-d381-4ace-9168-5446aa51963d None admin] RBAC: Adding query filter params (type=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:12.815240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e094c-d381-4ace-9168-5446aa51963d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.816679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e094c-d381-4ace-9168-5446aa51963d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.822820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 351/718] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:12.915057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:12.920691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dd306-fa65-4204-912a-f21280016506 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:12.966127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93178cfd-1a69-442c-a121-e18ea424e5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:12.966764 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178cfd-1a69-442c-a121-e18ea424e5d7 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:12.967046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178cfd-1a69-442c-a121-e18ea424e5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:12.967321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178cfd-1a69-442c-a121-e18ea424e5d7 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:12.968033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93178cfd-1a69-442c-a121-e18ea424e5d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:12.969561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93178cfd-1a69-442c-a121-e18ea424e5d7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:12.998887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 368/719] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:08:12 2022] POST /identity/v3/users => generated 254 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:14.385085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd31cc3-3c07-477d-a4da-f5db8a0fad33 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.385655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd31cc3-3c07-477d-a4da-f5db8a0fad33 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.385655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd31cc3-3c07-477d-a4da-f5db8a0fad33 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.387090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 352/720] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:14.392263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8569d-3025-4336-a7f4-19255272d5b6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.392664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8569d-3025-4336-a7f4-19255272d5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.392847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8569d-3025-4336-a7f4-19255272d5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.419005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b8f8569d-3025-4336-a7f4-19255272d5b6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:14.420226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b8f8569d-3025-4336-a7f4-19255272d5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:14.513899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 369/721] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 06 01:08:14.523776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c11d0-7694-4703-a3b4-f7fc6221dcba None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.524055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c11d0-7694-4703-a3b4-f7fc6221dcba None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.524325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c11d0-7694-4703-a3b4-f7fc6221dcba None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.525775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 353/722] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:14.530863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bed985-7f53-4ef9-9694-fa30f7aa14c9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.531146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bed985-7f53-4ef9-9694-fa30f7aa14c9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.531416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bed985-7f53-4ef9-9694-fa30f7aa14c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.554103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c11d0-7694-4703-a3b4-f7fc6221dcba None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:14.556557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c5bed985-7f53-4ef9-9694-fa30f7aa14c9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:14.559662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c5bed985-7f53-4ef9-9694-fa30f7aa14c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:14.630096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 370/723] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:14.664344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bed985-7f53-4ef9-9694-fa30f7aa14c9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:14.684828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:14.690363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:14.711387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c11d0-7694-4703-a3b4-f7fc6221dcba None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:14.771885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338def77-6445-4191-b60c-e8ab17803f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:14.772566 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338def77-6445-4191-b60c-e8ab17803f7b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.772840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338def77-6445-4191-b60c-e8ab17803f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.773110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338def77-6445-4191-b60c-e8ab17803f7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.799356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338def77-6445-4191-b60c-e8ab17803f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-338def77-6445-4191-b60c-e8ab17803f7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:14.807269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:14.808258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:14.809096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:14.811879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 354/724] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:14.813547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803475-a8fe-4684-9ab8-6c485da78400 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.814087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803475-a8fe-4684-9ab8-6c485da78400 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.814558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803475-a8fe-4684-9ab8-6c485da78400 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.816593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 355/725] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:14.817497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6803475-a8fe-4684-9ab8-6c485da78400 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:14.838479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bed985-7f53-4ef9-9694-fa30f7aa14c9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:14.880607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19276670-ece1-49c7-b7ef-10b8b4960a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:14.881247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19276670-ece1-49c7-b7ef-10b8b4960a61 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.881547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19276670-ece1-49c7-b7ef-10b8b4960a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.882221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19276670-ece1-49c7-b7ef-10b8b4960a61 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.882927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19276670-ece1-49c7-b7ef-10b8b4960a61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:14.884834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19276670-ece1-49c7-b7ef-10b8b4960a61 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:14.912345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 371/726] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:14 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:08:14.914271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e0ad-4454-488d-a1df-9638387062ed None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.914835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e0ad-4454-488d-a1df-9638387062ed None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.915341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e0ad-4454-488d-a1df-9638387062ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.955150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6803475-a8fe-4684-9ab8-6c485da78400 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:14.955546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a7e4e0ad-4454-488d-a1df-9638387062ed None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:14.957038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a7e4e0ad-4454-488d-a1df-9638387062ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:14.998148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:14.998148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:14.998148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:14.998148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:14.998590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:14.998590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:14.998590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.012354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 356/727] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:15.014596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.017490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:15.132695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 372/728] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:15.139498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0344f-e5ae-48a9-bc0c-8de13a50a886 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.183036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e0ad-4454-488d-a1df-9638387062ed None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.185425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:15.192142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.192142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.192142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.192142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.207929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:15.207929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:15.223948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:15.224967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:15.226582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:15.226582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:15.226582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:15.226582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:15.226582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 357/729] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:15.231193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.293916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:15.328377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e0ad-4454-488d-a1df-9638387062ed None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.343808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0a007-c1b1-4b6e-8c84-06b687ba62f4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.368435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcbcce-4039-4d6f-a04d-cccc5172a775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.369158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcbcce-4039-4d6f-a04d-cccc5172a775 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.369430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcbcce-4039-4d6f-a04d-cccc5172a775 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.369752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcbcce-4039-4d6f-a04d-cccc5172a775 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.381078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcbcce-4039-4d6f-a04d-cccc5172a775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:15.384033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd906e81-f572-414a-93e9-88b92b22575c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.384896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd906e81-f572-414a-93e9-88b92b22575c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.385386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd906e81-f572-414a-93e9-88b92b22575c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b7dcbcce-4039-4d6f-a04d-cccc5172a775 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:15.386332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:15.387317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:15.388700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 373/730] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:15.389395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca446-f5c8-478b-b07f-a8e6220c1fe7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.389395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca446-f5c8-478b-b07f-a8e6220c1fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.389518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ca446-f5c8-478b-b07f-a8e6220c1fe7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.389990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd906e81-f572-414a-93e9-88b92b22575c None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.390978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd906e81-f572-414a-93e9-88b92b22575c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:15.391491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd906e81-f572-414a-93e9-88b92b22575c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:15.393237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd906e81-f572-414a-93e9-88b92b22575c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.396188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 374/731] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:15.397718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ca446-f5c8-478b-b07f-a8e6220c1fe7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.413266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 358/732] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:15.413266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc532d67-92e4-4e16-98ac-058c33ad510d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.413266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc532d67-92e4-4e16-98ac-058c33ad510d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.413266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc532d67-92e4-4e16-98ac-058c33ad510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.432393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dc532d67-92e4-4e16-98ac-058c33ad510d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:15.433736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dc532d67-92e4-4e16-98ac-058c33ad510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:15.471954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:15.512072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 359/733] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 06 01:08:15.513120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc532d67-92e4-4e16-98ac-058c33ad510d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.540757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ca446-f5c8-478b-b07f-a8e6220c1fe7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.577074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:15.585678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.589329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.589607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.589882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.590689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:15.590998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:15.592402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.601995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 375/734] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:15.602860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.639787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc532d67-92e4-4e16-98ac-058c33ad510d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.679898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.680613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.680891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.681165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.688709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:15.690173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:15.702403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:15.704597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 360/735] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:15.706990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.722927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069310-e692-4a93-a186-1b3fd0ca6acc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.754393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:15.769351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.770390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.770801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.771187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.771891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:15.773295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.795465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 376/736] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:15 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:15.796293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.812946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17885d-fd6a-46cd-93f5-237ce322536f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.838324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:15.868337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fc4fc-ecd0-47ba-896e-28cd87884e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.869691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc4fc-ecd0-47ba-896e-28cd87884e7b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.870229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc4fc-ecd0-47ba-896e-28cd87884e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.870726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc4fc-ecd0-47ba-896e-28cd87884e7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.886629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fc4fc-ecd0-47ba-896e-28cd87884e7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:15.889221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fc4fc-ecd0-47ba-896e-28cd87884e7b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e61fc4fc-ecd0-47ba-896e-28cd87884e7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:15.910733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:15.911705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:15.912606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:15.912606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:15.912606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:15.912606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:15.912839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e08d4e8-71dc-4f17-aa3f-2547e207b338 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:15.916125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 361/737] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:15.917737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065161-a413-4ca0-8db1-b65f7bd95d07 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.918272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065161-a413-4ca0-8db1-b65f7bd95d07 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.918771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39065161-a413-4ca0-8db1-b65f7bd95d07 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.925421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 362/738] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:15.926741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39065161-a413-4ca0-8db1-b65f7bd95d07 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:15.961433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348865a0-c696-4dc6-8cfb-e2368a430f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:15.962262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348865a0-c696-4dc6-8cfb-e2368a430f44 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.962542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348865a0-c696-4dc6-8cfb-e2368a430f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.962811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348865a0-c696-4dc6-8cfb-e2368a430f44 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:15.963779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348865a0-c696-4dc6-8cfb-e2368a430f44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:15.964089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348865a0-c696-4dc6-8cfb-e2368a430f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:15.965879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348865a0-c696-4dc6-8cfb-e2368a430f44 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:15.985539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 377/739] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:15.987253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc65bc-57b8-45f8-a218-7a5254f12b1b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:15.987533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc65bc-57b8-45f8-a218-7a5254f12b1b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:15.987804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc65bc-57b8-45f8-a218-7a5254f12b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.007933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c8cc65bc-57b8-45f8-a218-7a5254f12b1b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:16.009127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8cc65bc-57b8-45f8-a218-7a5254f12b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:16.058300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.065998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39065161-a413-4ca0-8db1-b65f7bd95d07 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.091718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 378/740] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:16.092650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc65bc-57b8-45f8-a218-7a5254f12b1b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.125584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.126250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.126527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.127075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.127817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:16.128123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.129498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.142127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 363/741] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:16.142969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.163446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.209220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc65bc-57b8-45f8-a218-7a5254f12b1b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.246250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.246826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.247209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.247489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.251066 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2845f2f7-641b-4b59-8047-9fc345ccce69 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.258903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.260433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:16.278995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:16.279971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:16.280864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:16.280864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:16.280864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:16.280864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:16.280864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 379/742] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:16.281987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.293386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.294118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.294402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.294704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.305592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:16.310315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:16.312228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:16.314369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:16.316346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:16.321966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 364/743] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:16.321966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.392520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.409369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad403249-04e5-441d-a5ce-ae00457f55cd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.430202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc9b7-81d9-4a0c-a276-4b0b76eb6de1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.455071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.456047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.456332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.456848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.465275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.465902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.466426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.466699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.466971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.467397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:16.467703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.468471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.469076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:16.483182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:16.485325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 380/744] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:16.487615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.499407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 365/745] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:16.499407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.583705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.600075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e9372-6bf5-4299-929a-e5fc9d36e16e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.619573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439febe-e434-42e7-8542-8d07560a1bd4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.637449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.638159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.638438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.638709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.639777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:16.639777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.641138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.649881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 381/746] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:16.650539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.659735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.665905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.666859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.667774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.668251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.677942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.680151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:16.693196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:16.694315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:16.695339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:16.699159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 366/747] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:16.700012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.785996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c00e0-26c7-45ac-8ecf-b4e2afc7f87d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.816535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1f0be-0e66-46c3-8b35-8cee545677dc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:16.820370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.820803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.821082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.821351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.822181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:16.822491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.824024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.845214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 382/748] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:16.846353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.850584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.861681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:16.862405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:16.862682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:16.862951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:16.874637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:16.876149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:16.890986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:16.892093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:16.893186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:16.893186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:16.893186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:16.893186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:16.896919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 367/749] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:16.897757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:16.960435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:16.963285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabac3f-11ca-4ab8-a3e4-8e41f6264c6f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.000884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.001607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.001966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.002318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.003266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:17.003639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.005236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.023975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 383/750] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:17.025201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.033675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427e5ed-0f28-4149-8506-2f3a9a4fc801 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.078555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02abff-1434-4a71-a53d-f1b28a306739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.079690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02abff-1434-4a71-a53d-f1b28a306739 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.080127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02abff-1434-4a71-a53d-f1b28a306739 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.080544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02abff-1434-4a71-a53d-f1b28a306739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.097265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:17.146714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffeea9d-212e-4e0d-a1e7-90712f174daa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.154496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02abff-1434-4a71-a53d-f1b28a306739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.156315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02abff-1434-4a71-a53d-f1b28a306739 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.187511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.188146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.188431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.188703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.189401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:17.189697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.191265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.208455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 384/751] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:17.208455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.210005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:17.265661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 368/752] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:17.267258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edfd89-dddc-4503-a9bf-a408f2bb8996 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.267544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edfd89-dddc-4503-a9bf-a408f2bb8996 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.267820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edfd89-dddc-4503-a9bf-a408f2bb8996 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.269269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 369/753] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:17.270226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edfd89-dddc-4503-a9bf-a408f2bb8996 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.324715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985f7f6-e66e-4374-b9b0-acac9d3dcfbb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.353880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:17.369605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.370573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.370867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.371376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/2d0553dc133749eab4777d6552a93178/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.374052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=2d0553dc133749eab4777d6552a93178, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.375511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.375626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edfd89-dddc-4503-a9bf-a408f2bb8996 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.392004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 385/754] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:17 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/2d0553dc133749eab4777d6552a93178/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:17.392793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.427581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192e883-f140-4296-8687-387e2ceba2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.429144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192e883-f140-4296-8687-387e2ceba2ab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.429678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192e883-f140-4296-8687-387e2ceba2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.430222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192e883-f140-4296-8687-387e2ceba2ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.440731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192e883-f140-4296-8687-387e2ceba2ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.442733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192e883-f140-4296-8687-387e2ceba2ab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-9192e883-f140-4296-8687-387e2ceba2ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:17.458227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:17.459296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:17.460266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:17.463281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 370/755] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:17.465290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b54e4-667d-4f10-b266-d636b8f7fcf4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.465799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b54e4-667d-4f10-b266-d636b8f7fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.466315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b54e4-667d-4f10-b266-d636b8f7fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.476453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:17.491070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-841b54e4-667d-4f10-b266-d636b8f7fcf4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:17.492810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-841b54e4-667d-4f10-b266-d636b8f7fcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:17.533597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0405833-6a53-45e2-98b1-e68672a6c12d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.577787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.579022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.579518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.580032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.580402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 371/756] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:17.581324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b54e4-667d-4f10-b266-d636b8f7fcf4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.592294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.594204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:17.613040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:17.614050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:17.615497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:17.615497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:17.615497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:17.615497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:17.615497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 386/757] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:17.615497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.657197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:17.712400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b54e4-667d-4f10-b266-d636b8f7fcf4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.743161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa7e15-9d40-491d-a8f1-4b19656434cc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.757614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.758637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.759065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.759741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.761156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:17.761902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.763770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.766224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:17.789910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 372/758] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:17.790795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.791272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.792226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.792752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.793536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.795689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.797334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:17.810685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:17.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:17.812519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:17.816195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 387/759] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:17.817287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.905962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192b0c-6c39-47fe-ad74-dd2c997acf3c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.943593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.944229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.944512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.944785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:17.945493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:17.945798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:17.947227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:17.949267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:17.952160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb646cdd-b7c5-49bb-8725-16026fb8c3a5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:17.962130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 373/760] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:17.963351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:17.992427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:17.993044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:17.993342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:17.993617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.020082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.063362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.064863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.071012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798988f-101a-488a-8588-3a1e91c281af None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.108197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61511f0e-92a6-4f98-b6db-9144f99fef02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.108811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511f0e-92a6-4f98-b6db-9144f99fef02 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.109093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511f0e-92a6-4f98-b6db-9144f99fef02 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.109368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61511f0e-92a6-4f98-b6db-9144f99fef02 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.110200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511f0e-92a6-4f98-b6db-9144f99fef02 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:18.110527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511f0e-92a6-4f98-b6db-9144f99fef02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.111936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61511f0e-92a6-4f98-b6db-9144f99fef02 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.118938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 374/761] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:18.121380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ee0c-3d81-4ed8-be66-dba35c063e49 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.121674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ee0c-3d81-4ed8-be66-dba35c063e49 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.121969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912ee0c-3d81-4ed8-be66-dba35c063e49 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.125962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 375/762] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:18.125962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ee0c-3d81-4ed8-be66-dba35c063e49 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.179402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.185975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 388/763] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:18.185975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.235172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912ee0c-3d81-4ed8-be66-dba35c063e49 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.252801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.272560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0df42c-9503-4e3d-957c-30a135f0f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.273207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df42c-9503-4e3d-957c-30a135f0f012 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.273481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df42c-9503-4e3d-957c-30a135f0f012 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.273747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0df42c-9503-4e3d-957c-30a135f0f012 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.281351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0df42c-9503-4e3d-957c-30a135f0f012 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.283216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0df42c-9503-4e3d-957c-30a135f0f012 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.290813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d2bbd-adab-456a-899b-aeb2ec980632 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-cb0df42c-9503-4e3d-957c-30a135f0f012 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:18.294977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:18.295871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 376/764] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190ffab-755f-4edf-ba11-e459bce8caa3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.302534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190ffab-755f-4edf-ba11-e459bce8caa3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.303129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190ffab-755f-4edf-ba11-e459bce8caa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.316359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8190ffab-755f-4edf-ba11-e459bce8caa3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:18.317567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8190ffab-755f-4edf-ba11-e459bce8caa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:18.329258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.329875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.330182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.330581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.331281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:18.331664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.333030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.343254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 389/765] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:18.343254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.390929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 377/766] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:18.391773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190ffab-755f-4edf-ba11-e459bce8caa3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.416222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.456665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf0f-0ebc-4d41-8c2d-ae925f069314 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.491641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.492291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.492572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.492849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.503249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.504790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.507890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190ffab-755f-4edf-ba11-e459bce8caa3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.517884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:18.523068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:18.524104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:18.525343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:18.525343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:18.525343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:18.525343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:18.528932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 390/767] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:18.529832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.553096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.553726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.554032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.554303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.555055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:18.555361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.556793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.569562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 378/768] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:18.570448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.654187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d48578-3292-4226-9af8-4a35cdd7506a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.672580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.678058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc84ec2-954f-43a3-bb35-05a8e0ed9f23 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.697554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.698898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.699638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.700129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.701542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] RBAC: Adding query filter params (interface=public, service_id=f47c0049da2043cbae1062e36968262c, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:18.702360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.704430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.712096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.712686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.712963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.713231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] PATH_INFO: `/v3/services/network` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.713860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.715262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.717454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 391/769] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/endpoints?service_id=f47c0049da2043cbae1062e36968262c&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:18.718329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:18.724421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:18.725387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:18.726240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:18.730222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 379/770] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:18.731567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.762229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.821689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c409b99-e7f1-4307-ae02-23f75d91bf2b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.832182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455fe1e-585e-4f72-9d1d-182742d38a3c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.856553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.857180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.857456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.857722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.858452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:18.858757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.860214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.867724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:18.868355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:18.868632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:18.868926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:18.869718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=04de0ae1701b4367bf5be9da982bb251) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:18.870055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:18.871490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:18.876899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 392/771] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:18.876899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.881806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 380/772] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/role_assignments?user.id=04de0ae1701b4367bf5be9da982bb251&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:18.882532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:18.931179 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.986600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:18.993241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ed5c7-5ad1-406f-a6e2-e8ae70a0f2b2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:18.999238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d063d93-5dd1-4691-98ce-6ffe7b62e05c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:19.033042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.034182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.034465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.034734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.035436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] RBAC: Adding query filter params (name=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:19.035740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.037467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.042527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.042810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 381/773] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:19.043569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:19.043930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.044397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.044858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.045717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.047411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.054952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 393/774] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:18 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:19.062037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:19.150472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca169dd-9aee-4913-a384-fe892b4c5404 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:19.187602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.188274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.188563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.188822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.194909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83128415-1a42-4f66-b7c5-29fa7ba11782 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:19.196481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.197734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:19.197981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:19.211220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:19.212218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:19.213103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 382/775] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:19.218320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:19.239308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:19.243100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.243754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.244035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.244363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.253060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:19.253439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.255066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.265450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 394/776] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:19.271715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:19.329699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47444e01-4fbe-40c7-ad41-42aacd7a431a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:19.378965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.379588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.379925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.380190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.385331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:19.385656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.387214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.402202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 383/777] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:19.410652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:19.420334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec1175-0148-420f-b164-1e71f88a5f16 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:19.473954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.473954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.473954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.473954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.474378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] RBAC: Adding query filter params (interface=public, service_id=32d24d5733a94383aad06c9cecb987a7, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:19.474378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.474378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.480709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 395/778] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:08:19 2022] GET /identity/v3/endpoints?service_id=32d24d5733a94383aad06c9cecb987a7&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:19.485552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:19.551860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:19.554301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:19.594697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e7f2e-f675-455a-a8cc-c92e752b149e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:19.645434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4eafe-065e-4494-80d5-5d559531b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.646627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4eafe-065e-4494-80d5-5d559531b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.647134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4eafe-065e-4494-80d5-5d559531b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.647665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4eafe-065e-4494-80d5-5d559531b1c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.648660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4eafe-065e-4494-80d5-5d559531b1c8 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=77e9dbe99d734b958a5ee8047880c741) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:19.649167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4eafe-065e-4494-80d5-5d559531b1c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.650955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4eafe-065e-4494-80d5-5d559531b1c8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.653133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2bfc-092a-4936-b651-3e60636fa67b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:19.665956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 384/779] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:19 2022] GET /identity/v3/role_assignments?user.id=77e9dbe99d734b958a5ee8047880c741&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:19.665956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b181-dd40-4fe7-b943-b65b2f43800a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.665956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b181-dd40-4fe7-b943-b65b2f43800a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.665956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2b181-dd40-4fe7-b943-b65b2f43800a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.665956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 385/780] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:19.679737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f03d-1a2a-48e5-96b8-35b99609c5b3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.680056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f03d-1a2a-48e5-96b8-35b99609c5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.680268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f03d-1a2a-48e5-96b8-35b99609c5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.709516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-be21f03d-1a2a-48e5-96b8-35b99609c5b3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:19.710763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-be21f03d-1a2a-48e5-96b8-35b99609c5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:19.720648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:19.721424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:19.721673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:19.723621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:19.724317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:19.725757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:19.732541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 396/781] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:19 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:19.842272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 386/782] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:19.868152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:19.970657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:19.978693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f26d0c-7fa7-4f49-9823-6bf8c45055ea None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:20.013115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:20.014152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:20.014632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:20.015099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:20.026338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:20.031939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:20.032875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:20.033796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:20.036503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 397/783] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:20.042806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f03d-1a2a-48e5-96b8-35b99609c5b3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:20.138948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:20.180669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f03d-1a2a-48e5-96b8-35b99609c5b3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:20.226332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:20.226992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:20.227271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:20.227547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:20.228284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:20.228588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:20.230038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:20.245967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 387/784] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:20.252008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:20.382875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ba03-2443-47c2-a480-cfa50af319f2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:20.427955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:20.428606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:20.428880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:20.429150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:20.445680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:20.447189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:20.465917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:20.466899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:20.467816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:20.467816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:20.467816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:20.467816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:20.470056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 398/785] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:20.475963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:20.628439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398fb6f-6ea6-4b46-8b74-a47d9aecb511 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:20.674835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:20.675516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:20.675796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:20.676066 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:20.676764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:20.677067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:20.678530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:20.680034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:20.702257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 388/786] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:20.702689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:20.721836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:20.836763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928d82e-1173-4b52-b573-a997ee669747 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:20.870522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:20.871225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:20.871513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:20.871789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:20.879569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:20.881041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:20.892437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:20.893452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:20.894417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 399/787] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:08:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:20.901352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:21.025220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2043d-0c16-4da7-985f-603d1dd572f5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:21.075219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9661f3a-3ac0-47ae-8085-00c336a12db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:21.076165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9661f3a-3ac0-47ae-8085-00c336a12db6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.076647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9661f3a-3ac0-47ae-8085-00c336a12db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.077096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9661f3a-3ac0-47ae-8085-00c336a12db6 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.078096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9661f3a-3ac0-47ae-8085-00c336a12db6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:21.078581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9661f3a-3ac0-47ae-8085-00c336a12db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:21.080246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9661f3a-3ac0-47ae-8085-00c336a12db6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:21.104088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 389/788] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:08:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:21.109339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:21.194590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:21.235637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a2bf-10c0-4c03-a706-a25e8c7b5b96 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:21.271068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:21.272009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.272507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.272959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.342917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:21.344744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:21.411989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:21.422984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095484c-b0f1-472d-8420-e72510e20bae None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.423621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095484c-b0f1-472d-8420-e72510e20bae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.424558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095484c-b0f1-472d-8420-e72510e20bae None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.430874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 390/789] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:21.433365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240486-d0ce-4cfb-a39d-4f1adc557a34 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.433865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240486-d0ce-4cfb-a39d-4f1adc557a34 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.434603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24240486-d0ce-4cfb-a39d-4f1adc557a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.464833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-24240486-d0ce-4cfb-a39d-4f1adc557a34 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:21.466438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-24240486-d0ce-4cfb-a39d-4f1adc557a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:21.466814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 400/790] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:21.472712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:21.545323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:21.574040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 391/791] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:21.575669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d653b-45b3-43ce-965e-f4d05c2c2e62 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.576083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d653b-45b3-43ce-965e-f4d05c2c2e62 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.576508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d653b-45b3-43ce-965e-f4d05c2c2e62 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.583912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 392/792] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:21.586142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5cd93-80ee-47c7-8b12-b6a1bee26d7d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.590621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5cd93-80ee-47c7-8b12-b6a1bee26d7d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.591046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5cd93-80ee-47c7-8b12-b6a1bee26d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.613739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e9b5cd93-80ee-47c7-8b12-b6a1bee26d7d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:21.615168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e9b5cd93-80ee-47c7-8b12-b6a1bee26d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:21.633423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d49cc-ace5-4af1-a8e6-786a1b9048c1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:21.676538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:21.677686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.678133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.678573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.691239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:21.693344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:21.705949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 393/793] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:21.705949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5cd93-80ee-47c7-8b12-b6a1bee26d7d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:21.727567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:21.728826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:21.729704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:21.729704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:21.729704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:21.729704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:21.731876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 401/794] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:21.732418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:21.759515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:21.838635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5cd93-80ee-47c7-8b12-b6a1bee26d7d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:21.855549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:21.855721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebe518-2ee2-4916-a71d-8b7b1810ec0b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:21.880056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:21.881079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.881671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.882177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.893922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:21.897203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:21.897957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:21.898316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:21.898664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:21.899377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:21.900628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:21.901525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:21.902385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:21.903009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:21.905990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 394/795] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:21.907421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:21.918788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:21.919773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 06 01:08:21.920608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:21.925108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 402/796] 10.222.0.17 () {56 vars in 1129 bytes} [Sat Aug 6 01:08:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:21.925964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.017146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.017714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db06df-33bf-4f43-a29d-032a5c28bf50 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.034544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3e154-a0c9-496c-b726-964af29293b6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.056652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.057667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.058207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.058758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.059746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:22.060249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.061922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.071514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.072205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.072768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.072886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.073539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:22.073846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.075327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.077083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 395/797] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:22.078280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.089913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 403/798] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:22.091048 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.111667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.190787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2fdc6-536e-4b45-97ee-7b76cc1bbcdd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.199890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba66b50-6712-4258-9582-c5624ab69ad8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.226125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.226749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.227045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.227321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.228157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:22.228263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.229606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.238849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 396/799] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:22.238849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.241139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c6ea7-ccf0-454b-959e-346a3d416142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.241800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c6ea7-ccf0-454b-959e-346a3d416142 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.242116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c6ea7-ccf0-454b-959e-346a3d416142 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.242390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c6ea7-ccf0-454b-959e-346a3d416142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.250969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c6ea7-ccf0-454b-959e-346a3d416142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.252584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c6ea7-ccf0-454b-959e-346a3d416142 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-924c6ea7-ccf0-454b-959e-346a3d416142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:22.264299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:22.265216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 404/800] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:22.266866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5477-34e4-4774-9d32-cb01c7d7b1e0 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.267407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5477-34e4-4774-9d32-cb01c7d7b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.267407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5477-34e4-4774-9d32-cb01c7d7b1e0 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.272543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 405/801] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:22.272543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a5477-34e4-4774-9d32-cb01c7d7b1e0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.280095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.344806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.352122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0efd40-b746-4151-a1ec-a3bec6d7d5f4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.382076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a5477-34e4-4774-9d32-cb01c7d7b1e0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.385678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.386360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.386637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.386905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.397316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.398781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:22.412995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:22.414091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:22.415011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:22.415011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:22.415011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:22.415011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:22.415011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 397/802] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:22.415310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.418204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f338ce8-4e9c-49d7-9d10-90b2977ae1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.418929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338ce8-4e9c-49d7-9d10-90b2977ae1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.419214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338ce8-4e9c-49d7-9d10-90b2977ae1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.419493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f338ce8-4e9c-49d7-9d10-90b2977ae1b1 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.420178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338ce8-4e9c-49d7-9d10-90b2977ae1b1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:22.420485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338ce8-4e9c-49d7-9d10-90b2977ae1b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.421879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f338ce8-4e9c-49d7-9d10-90b2977ae1b1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.431495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 406/803] 10.222.0.17 () {56 vars in 1124 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:22.431495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe12d0-cacf-4702-9705-477be6daf415 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.431495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe12d0-cacf-4702-9705-477be6daf415 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.431495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe12d0-cacf-4702-9705-477be6daf415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.447695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ebbe12d0-cacf-4702-9705-477be6daf415 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:22.448823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ebbe12d0-cacf-4702-9705-477be6daf415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:22.514713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.520640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 407/804] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:22.521859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546afd9-b6d5-4275-854e-3fa9574be621 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.522165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546afd9-b6d5-4275-854e-3fa9574be621 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.522434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546afd9-b6d5-4275-854e-3fa9574be621 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.523664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 408/805] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:22.524337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546afd9-b6d5-4275-854e-3fa9574be621 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.538032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8aa67f-6941-43c7-968c-0cd49ddd608e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.571540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.572161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.572436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.572701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.573447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:22.573753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.575209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.587252 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 398/806] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:22.588010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.598403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.624236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546afd9-b6d5-4275-854e-3fa9574be621 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.657466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e0abd-b1c4-4173-bb19-c370cbd923c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.658118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0abd-b1c4-4173-bb19-c370cbd923c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.658366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0abd-b1c4-4173-bb19-c370cbd923c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.658726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e0abd-b1c4-4173-bb19-c370cbd923c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.659429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e0abd-b1c4-4173-bb19-c370cbd923c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:22.659735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e0abd-b1c4-4173-bb19-c370cbd923c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.661132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e0abd-b1c4-4173-bb19-c370cbd923c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.676784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 409/807] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:22.676784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca73d9c-60b8-41df-b37f-775444b770f4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.676784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca73d9c-60b8-41df-b37f-775444b770f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.676784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca73d9c-60b8-41df-b37f-775444b770f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.686435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dec588-88e2-4afc-8490-537e3bf56391 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.691095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5ca73d9c-60b8-41df-b37f-775444b770f4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:22.692283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5ca73d9c-60b8-41df-b37f-775444b770f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:22.721411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.722027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.722286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.722554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.723254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.724609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.745696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 399/808] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:22.746544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.746721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.777109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 410/809] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:22.778247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca73d9c-60b8-41df-b37f-775444b770f4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.815845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:22.861944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b3e84-b080-497d-bfa7-4ca8c86f62ee None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.889448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca73d9c-60b8-41df-b37f-775444b770f4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:22.903133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.903919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.904197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.904778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] PATH_INFO: `/v3/services/network` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.905143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.906943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:22.917018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:22.918120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:22.918948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 400/810] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:22.919738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:22.936617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:22.936617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:22.936977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:22.937567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:22.938411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=2d0553dc133749eab4777d6552a93178) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:22.938718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:22.940220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:22.950869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 411/811] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/role_assignments?user.id=2d0553dc133749eab4777d6552a93178&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:22.952343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.026166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:23.049886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ccc4e-754f-482b-8e48-b8fe13d571aa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.080850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:23.090472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.091309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.091687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.092055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.100716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.102405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.113156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82de7a-fe59-4e17-9b4a-2a4b6015156d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:23.120593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:23.121542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 401/812] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:23.128426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.152268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.152933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.153210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.153479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.166673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:23.173269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:23.174506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 412/813] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:23.175548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.259342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f21363-6218-44b0-b488-b4d245e3fc5b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.293139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6273df-a485-499a-a344-7076c32fcbae None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.305014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:23.305994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.306901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.307213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.307629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.308325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] RBAC: Adding query filter params (name=network) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:23.308629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.310202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.321830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 402/814] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:23.321830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.338773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.339586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.340042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.340319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.341177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:23.341490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.343818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.372106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 413/815] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:23.372106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.394231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:23.456306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b107f49-784b-42e7-94b6-39d467887130 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.482552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f6079-f2ac-482e-a48f-776d6e14e83d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.497313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.497986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.498270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.498558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.499265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:23.499565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.501040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.515035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 403/816] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:23.515035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.532775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.533485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.533828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.534149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.535120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] RBAC: Adding query filter params (type=network) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:23.535424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.536988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.546057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 414/817] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:23.547379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.589900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:23.651629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce2940-e862-4a21-9601-d5ee8cd1e974 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.666716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:23.670733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66085d5-8b77-4418-a15a-e1aa5209dd49 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.688592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.689343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.689644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.689940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.701509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.703236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.708149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.709009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.709492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.710009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:23.718243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:23.719131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:23.720018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:23.720018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:23.720018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:23.720018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:23.722923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.724136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 404/818] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:23.724945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.725241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:23.741124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:23.742324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:23.743365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:23.743365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:23.743365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:23.743365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:23.745213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 415/819] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:23.746245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.831689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:23.832959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc8b22-76b1-4116-bce7-f23225cd1709 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.849498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b44186-4d10-4f42-ad98-5fdadd2486f5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:23.867888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.868522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.868849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.869124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.869826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.871411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.886151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:23.887035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:23.887461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:23.887882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:23.888790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:23.889239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:23.891007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:23.902143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 405/820] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:23.903270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.905871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 416/821] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:23.925866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:23.943054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:24.039592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92add226-e6f7-4a74-aac2-a2882a3f2b55 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.096008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.096640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.096920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.097191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.097899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:24.098227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.099657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.113457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 406/822] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:24.119436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:24.136116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9439ab81-f8c9-4fd1-a205-f957ae0fbe27 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.183050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.183546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.183949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.184222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.193006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.194608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:24.207115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:24.208227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:24.209372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:24.213032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 417/823] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:24.214382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:24.217918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:24.234265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:24.259321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47dd510-9f27-4c7d-b89a-a5dcb1f46398 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.298999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.300052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.300475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.300886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.311853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.314144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.322689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5e43-1d8e-4ef2-a989-8af0ddafcf4e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:24.328142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:24.329296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:24.330498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:24.332606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 407/824] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:08:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:24.337959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:24.360639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.361191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.361468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.361901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.362674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:24.363022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.364527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.387358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 418/825] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:24.388591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:24.463053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:24.472616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2c48-a1b9-413d-b0e8-a89521bb6560 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.510136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cd660-5a4d-4713-952e-7214a1c45025 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.520364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.521665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.522134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.522988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.524241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:24.524712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.527080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.539876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:24.548836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.549297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.549663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.550051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/04de0ae1701b4367bf5be9da982bb251/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.552121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=04de0ae1701b4367bf5be9da982bb251, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.553436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 408/826] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 01:08:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:24.553920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.558931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:24.578143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 419/827] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:24 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/04de0ae1701b4367bf5be9da982bb251/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:24.684158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e4705-7cc5-4c69-b6de-a4389a33d203 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.723285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b56c0c-b192-4228-845f-396cf1c2dfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.724217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56c0c-b192-4228-845f-396cf1c2dfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.725091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56c0c-b192-4228-845f-396cf1c2dfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.725519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56c0c-b192-4228-845f-396cf1c2dfb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.737421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b56c0c-b192-4228-845f-396cf1c2dfb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.739328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b56c0c-b192-4228-845f-396cf1c2dfb8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d1b56c0c-b192-4228-845f-396cf1c2dfb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:24.755770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:24.756862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:24.757917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:24.757917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:24.757917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:24.757917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:24.759821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 409/828] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:24.765076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:24.869164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab9f6c-23ab-4315-8c3d-90375e8f04dd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:24.892013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2d21d-02f0-4c7b-af1a-e288bd5e23c0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.892337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2d21d-02f0-4c7b-af1a-e288bd5e23c0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.892568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2d21d-02f0-4c7b-af1a-e288bd5e23c0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.893221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:24.894234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 410/829] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:24.899237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e09d-f796-4676-8c16-0eb1e6ad0f4f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.899535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e09d-f796-4676-8c16-0eb1e6ad0f4f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.900142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e09d-f796-4676-8c16-0eb1e6ad0f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.907009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:24.909336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:24.910011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:24.910537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:24.911455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:24.911975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:24.913615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:24.920449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3813e09d-f796-4676-8c16-0eb1e6ad0f4f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:24.921648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3813e09d-f796-4676-8c16-0eb1e6ad0f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:24.929152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 420/830] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:24.938037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:24.982253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:25.015658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 411/831] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:25.037234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e09d-f796-4676-8c16-0eb1e6ad0f4f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.050521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af6882-ae77-4cec-9dcf-a1b320379d42 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.094822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19c373-5e6f-42c8-bffc-18ca4a0f72e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.096169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c373-5e6f-42c8-bffc-18ca4a0f72e4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.096860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c373-5e6f-42c8-bffc-18ca4a0f72e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.097282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c373-5e6f-42c8-bffc-18ca4a0f72e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.114763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19c373-5e6f-42c8-bffc-18ca4a0f72e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.118035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19c373-5e6f-42c8-bffc-18ca4a0f72e4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8b19c373-5e6f-42c8-bffc-18ca4a0f72e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:25.130320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:25.131345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:25.132383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 421/832] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:25.133379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a9ab-b07b-4b38-a842-6d31ec49aba1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.133659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a9ab-b07b-4b38-a842-6d31ec49aba1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.133970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a9ab-b07b-4b38-a842-6d31ec49aba1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.135437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 422/833] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:25.138948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a9ab-b07b-4b38-a842-6d31ec49aba1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.147664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e09d-f796-4676-8c16-0eb1e6ad0f4f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.187256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fde79-2ff7-4613-bd3f-f8e94d4bfdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.188274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fde79-2ff7-4613-bd3f-f8e94d4bfdae None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.188653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fde79-2ff7-4613-bd3f-f8e94d4bfdae None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.188935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fde79-2ff7-4613-bd3f-f8e94d4bfdae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.189601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fde79-2ff7-4613-bd3f-f8e94d4bfdae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.190770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:25.191022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fde79-2ff7-4613-bd3f-f8e94d4bfdae None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-577fde79-2ff7-4613-bd3f-f8e94d4bfdae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:25.200290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:25.201269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:25.202424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 412/834] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:25.203341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b30cd-e107-4854-9f52-c1cda310643b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.203341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b30cd-e107-4854-9f52-c1cda310643b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.203341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b30cd-e107-4854-9f52-c1cda310643b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.220818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f41b30cd-e107-4854-9f52-c1cda310643b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:25.222048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f41b30cd-e107-4854-9f52-c1cda310643b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:25.256863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192a9ab-b07b-4b38-a842-6d31ec49aba1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.259903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:25.293508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 413/835] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:25.294453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b30cd-e107-4854-9f52-c1cda310643b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.303017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.303828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.304250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.304689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.305650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:25.313951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.313951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.325564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 423/836] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:25.326338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.414313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b30cd-e107-4854-9f52-c1cda310643b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.438356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2d867-8c34-41f3-8835-3defe9cdae95 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.442466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:25.449593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.450254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.450506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.450772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.451493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:25.451784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.453169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.462157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 414/837] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:25.462157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.485869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.486918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.487185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.487458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.488232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.490256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.493051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:25.500479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:25.501451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:25.502490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:25.506508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 424/838] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Aug 6 01:08:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:25.507579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.574478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd72b5-7cc9-4dbb-a1b8-1183dfc46f52 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.609819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.610629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.610908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.611184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/77e9dbe99d734b958a5ee8047880c741/roles/4cae790876e1492fbe3d3a314f0de80f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.617906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705e648-3b6a-4716-b861-673722776bd5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.626848 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=77e9dbe99d734b958a5ee8047880c741, role_id=4cae790876e1492fbe3d3a314f0de80f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.628420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.650603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 415/839] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:25 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/77e9dbe99d734b958a5ee8047880c741/roles/4cae790876e1492fbe3d3a314f0de80f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:25.650603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.677421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.678223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.678578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.678942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.679778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:25.680447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.682938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.694213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 425/840] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:25.761250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:25.786593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1e11-836e-4ba3-bf64-93204e615175 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.829295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2561aad-665f-4982-847f-1087065d3c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.829962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2561aad-665f-4982-847f-1087065d3c49 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.830310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2561aad-665f-4982-847f-1087065d3c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.830641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2561aad-665f-4982-847f-1087065d3c49 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.831347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2561aad-665f-4982-847f-1087065d3c49 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:25.831703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2561aad-665f-4982-847f-1087065d3c49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.833119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2561aad-665f-4982-847f-1087065d3c49 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:25.839035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 416/841] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:25.844675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:25.882344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:25.955272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93673076-f2b7-429b-9254-d768998a9fb5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:25.989868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034de68-b5ee-464e-8700-ff57236444fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:25.990999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034de68-b5ee-464e-8700-ff57236444fc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:25.991454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034de68-b5ee-464e-8700-ff57236444fc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:25.991897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034de68-b5ee-464e-8700-ff57236444fc None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:25.992761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034de68-b5ee-464e-8700-ff57236444fc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:25.993237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034de68-b5ee-464e-8700-ff57236444fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:25.994824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034de68-b5ee-464e-8700-ff57236444fc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:26.006026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 426/842] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:26.628095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00e85-83da-45c5-9606-0f8dfa75be1b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:26.628471 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00e85-83da-45c5-9606-0f8dfa75be1b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:26.628663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e00e85-83da-45c5-9606-0f8dfa75be1b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:26.630330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 417/843] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:26.635537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197704e-604d-4546-93d1-8dc4d8735793 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:26.635829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197704e-604d-4546-93d1-8dc4d8735793 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:26.636107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197704e-604d-4546-93d1-8dc4d8735793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:26.654713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0197704e-604d-4546-93d1-8dc4d8735793 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:26.655912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0197704e-604d-4546-93d1-8dc4d8735793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:26.729670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 427/844] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:26.752463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00e85-83da-45c5-9606-0f8dfa75be1b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:26.861300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e00e85-83da-45c5-9606-0f8dfa75be1b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:26.896835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:26.897512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:26.897794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:26.898098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:26.910964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:26.915919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:26.916832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:26.918270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 418/845] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:26.923227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197704e-604d-4546-93d1-8dc4d8735793 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:26.950789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:27.028980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197704e-604d-4546-93d1-8dc4d8735793 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:27.063974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:27.064940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.065370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.065859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.066778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:27.067234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:27.068784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:27.077749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 428/846] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:27.083612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:27.097423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:27.193456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad28b54-2cd8-4773-aad7-c40f081c4963 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:27.228986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:27.229641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.229921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.230220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.241131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:27.242623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:27.257809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:27.258797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:27.259715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:27.259715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:27.259715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:27.259715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:27.259715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 419/847] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:27.266289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:27.358289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:27.370607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86957b5-c689-43f0-885e-9f1d2cf44cb5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:27.407571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:27.408236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.408577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.408853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.409556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:27.409957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:27.411364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:27.425374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 429/848] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:27.432148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:27.498540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:27.538897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eff46-98ac-4794-a7c3-483b0148ffcd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:27.573393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28fee5-1b48-4474-a880-4d854b310987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:27.574076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28fee5-1b48-4474-a880-4d854b310987 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.574366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28fee5-1b48-4474-a880-4d854b310987 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.574635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28fee5-1b48-4474-a880-4d854b310987 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.582534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28fee5-1b48-4474-a880-4d854b310987 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:27.584003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28fee5-1b48-4474-a880-4d854b310987 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-bb28fee5-1b48-4474-a880-4d854b310987 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:27.595543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:27.596631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:27.597588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 420/849] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:27.604628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:27.710197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc114e-2b07-48fd-b73f-9cebf588fd35 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:27.730046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b63d-3120-4569-8a1d-a7d52518457a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.730365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b63d-3120-4569-8a1d-a7d52518457a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.730616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707b63d-3120-4569-8a1d-a7d52518457a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.732895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 421/850] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:27.739094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda369f8-caaf-477c-876a-1a25bb5740d4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.739374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda369f8-caaf-477c-876a-1a25bb5740d4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.739641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda369f8-caaf-477c-876a-1a25bb5740d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.753530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:27.754906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.755644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.756104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.757117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:27.757609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:27.759472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cda369f8-caaf-477c-876a-1a25bb5740d4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:27.759593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:27.760734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cda369f8-caaf-477c-876a-1a25bb5740d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:27.781741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 430/851] 10.222.0.17 () {56 vars in 1135 bytes} [Sat Aug 6 01:08:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:27.787461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:27.802270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:27.833970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 422/852] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:27.862079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda369f8-caaf-477c-876a-1a25bb5740d4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:27.913560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b645-362a-4b36-a50c-af5535668a0d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:27.919581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:27.949749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a66adc7-e0df-4350-b415-24c432ff2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:27.951022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66adc7-e0df-4350-b415-24c432ff2c5f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:27.951463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66adc7-e0df-4350-b415-24c432ff2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:27.951738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a66adc7-e0df-4350-b415-24c432ff2c5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:27.972842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda369f8-caaf-477c-876a-1a25bb5740d4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.007884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39990e61-36ba-4881-b157-5dae431eed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.008737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39990e61-36ba-4881-b157-5dae431eed5d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.009030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39990e61-36ba-4881-b157-5dae431eed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.009289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39990e61-36ba-4881-b157-5dae431eed5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.021196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39990e61-36ba-4881-b157-5dae431eed5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:28.022555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66adc7-e0df-4350-b415-24c432ff2c5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.024040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a66adc7-e0df-4350-b415-24c432ff2c5f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-39990e61-36ba-4881-b157-5dae431eed5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:28.026162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:28.027074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:28.027915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 423/853] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:08:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:28.028625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faea9-f8f2-4eba-b3c0-c2404e9ef4d7 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.030005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faea9-f8f2-4eba-b3c0-c2404e9ef4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.030005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785faea9-f8f2-4eba-b3c0-c2404e9ef4d7 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.034741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 424/854] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:28.035290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785faea9-f8f2-4eba-b3c0-c2404e9ef4d7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.038918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.131020 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 431/855] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:08:28.132291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7052ad-fc16-4a14-9352-3bbb051d6b72 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.132587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7052ad-fc16-4a14-9352-3bbb051d6b72 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.132857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7052ad-fc16-4a14-9352-3bbb051d6b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.135892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785faea9-f8f2-4eba-b3c0-c2404e9ef4d7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.149509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.150155 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fc7052ad-fc16-4a14-9352-3bbb051d6b72 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:28.151480 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fc7052ad-fc16-4a14-9352-3bbb051d6b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:28.171509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad41cc-3d8a-4fb3-940e-dec4f5f5bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.172175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad41cc-3d8a-4fb3-940e-dec4f5f5bad0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.172473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad41cc-3d8a-4fb3-940e-dec4f5f5bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.172763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad41cc-3d8a-4fb3-940e-dec4f5f5bad0 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.173529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad41cc-3d8a-4fb3-940e-dec4f5f5bad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:28.173888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad41cc-3d8a-4fb3-940e-dec4f5f5bad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.175319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad41cc-3d8a-4fb3-940e-dec4f5f5bad0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.183241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 425/856] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:28.184396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc439859-2713-4fb8-bb2f-06eb489de057 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.184680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc439859-2713-4fb8-bb2f-06eb489de057 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.184955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc439859-2713-4fb8-bb2f-06eb489de057 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.186194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 426/857] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:28.186935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc439859-2713-4fb8-bb2f-06eb489de057 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.225043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 432/858] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:28.225885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7052ad-fc16-4a14-9352-3bbb051d6b72 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.259336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.298989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc439859-2713-4fb8-bb2f-06eb489de057 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.323881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7052ad-fc16-4a14-9352-3bbb051d6b72 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.333445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0767776-7345-4df3-9d8d-6ac17b4ec1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.334157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0767776-7345-4df3-9d8d-6ac17b4ec1dc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.334439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0767776-7345-4df3-9d8d-6ac17b4ec1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.334698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0767776-7345-4df3-9d8d-6ac17b4ec1dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.344693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0767776-7345-4df3-9d8d-6ac17b4ec1dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.346211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0767776-7345-4df3-9d8d-6ac17b4ec1dc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.357923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.358625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.358905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.359182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a0767776-7345-4df3-9d8d-6ac17b4ec1dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:28.360716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:28.361661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:28.363119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:28.363119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:28.363119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:28.363119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:28.363119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 427/859] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:28.363119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cdbed-a9ef-4749-a754-f6b75000ebf6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.363533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cdbed-a9ef-4749-a754-f6b75000ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.363614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13cdbed-a9ef-4749-a754-f6b75000ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.375169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.376646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.380958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f13cdbed-a9ef-4749-a754-f6b75000ebf6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:28.382175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f13cdbed-a9ef-4749-a754-f6b75000ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:28.391934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:28.393007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:28.393908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:28.393908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:28.393908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:28.393908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:28.393908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 433/860] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:28.393908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.408253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.455860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 428/861] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:28.456691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cdbed-a9ef-4749-a754-f6b75000ebf6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.482576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.498978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafa8b8-31c3-4ec4-b3fe-5191f74efce0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.532883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.533504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.533787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.534096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.534797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.536200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.550964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 434/862] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:28 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:28.551761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.556003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13cdbed-a9ef-4749-a754-f6b75000ebf6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.608314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.609634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.609923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.610213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.610938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:28.611773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.613552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.633474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 429/863] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:28.633474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.650892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.678291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f4e40-db9d-4911-9aab-110b6425be67 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.717189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.718890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.718890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.718890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.719246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:28.719515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.720988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.736571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 435/864] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:28.737470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.758037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.758248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186bde6-8119-4801-a3a4-32f469a2b2ab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.790108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.791017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.791294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.791572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.792606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.794030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.821959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 430/865] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:28 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:28.821959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.884074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418e5af-4539-4eb7-8359-47e61c515761 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.904894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:28.944031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.944888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.945265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.945638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:28.947687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe88402-e81a-4e96-8836-98e3703955f5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:28.954122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:28.955851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:28.968797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:28.969953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:28.971567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:28.973226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 436/866] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:28.978582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:28.994118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:28.994785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:28.995070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:28.995477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:29.004092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:29.006139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:29.019710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:29.020687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:29.022110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 431/867] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:29.026998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:29.059375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:29.110703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098688c-1281-40f5-b6aa-0de87c3213cb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:29.140557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827e76e-50dd-48bb-8668-96270a178848 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:29.159918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:29.160793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:29.161215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:29.161652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:29.163079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:29.163678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:29.165662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:29.172879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:29.182362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:29.183059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:29.183342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:29.183615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:29.184423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:29.184732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:29.185630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 437/868] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:29.190161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:29.194345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:29.208255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 432/869] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 01:08:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:29.214278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:29.297619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd46f5f-40e4-489c-9af6-f6e53ff6cd9e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:29.318274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a54ffd-60a7-4634-9961-b941432fc2bc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:29.322411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:29.333683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:29.334343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:29.334624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:29.334890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:29.335685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=04de0ae1701b4367bf5be9da982bb251) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:29.335993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:29.337440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:29.343829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 438/870] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:29 2022] GET /identity/v3/role_assignments?user.id=04de0ae1701b4367bf5be9da982bb251&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:29.362220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:29.362882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:29.363220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:29.363496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:29.429016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:29.440563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:29.442281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:29.553214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 433/871] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:29 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:08:29.558890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:29.672223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b740e-8b76-4827-a2ee-6c17d96754ec None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:29.710388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:29.711046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:29.711326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:29.711603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:29.722526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:29.724021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:29.738581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:29.739645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:29.740741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:29.740741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:29.740741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:29.740741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:29.740741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 439/872] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:29.746814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:29.839223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:29.849447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c7a13a-f1e4-4845-9aa6-7b7fb526ccc3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:29.884731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:29.885361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:29.885639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:29.885909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:29.886643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:29.886943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:29.888385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:29.900537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 434/873] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:29.906456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:29.950257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:30.011102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc8e3b-9478-40ce-bb78-410e4e501020 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:30.047382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:30.048057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:30.048335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:30.048610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:30.056422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:30.057895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:30.069761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:30.070697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:30.072374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 440/874] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:30.076772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:30.184679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c53ca6-89a8-49f3-8f8e-b366167d1352 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:30.220149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec8ce0-04e1-4f37-b465-f98356db5584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:30.221256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec8ce0-04e1-4f37-b465-f98356db5584 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:30.221751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec8ce0-04e1-4f37-b465-f98356db5584 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:30.222230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec8ce0-04e1-4f37-b465-f98356db5584 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:30.223184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec8ce0-04e1-4f37-b465-f98356db5584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:30.223680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec8ce0-04e1-4f37-b465-f98356db5584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:30.225323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec8ce0-04e1-4f37-b465-f98356db5584 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:30.238311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 435/875] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:30.244407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:30.348242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:30.351464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb209e4-497c-4891-ab8a-cdd3a8f1c5ef None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:30.385961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583f64f-019a-4d7b-8ba5-01bac816d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:30.386604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583f64f-019a-4d7b-8ba5-01bac816d334 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:30.386883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583f64f-019a-4d7b-8ba5-01bac816d334 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:30.387154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583f64f-019a-4d7b-8ba5-01bac816d334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:30.387948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583f64f-019a-4d7b-8ba5-01bac816d334 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=77e9dbe99d734b958a5ee8047880c741) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:30.388260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583f64f-019a-4d7b-8ba5-01bac816d334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:30.389768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583f64f-019a-4d7b-8ba5-01bac816d334 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:30.396271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 441/876] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:30 2022] GET /identity/v3/role_assignments?user.id=77e9dbe99d734b958a5ee8047880c741&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:30.651549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdd4d0-749b-4383-9910-73a0812798ef None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:30.652245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdd4d0-749b-4383-9910-73a0812798ef None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:30.652741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdd4d0-749b-4383-9910-73a0812798ef None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:30.654614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 436/877] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:30.660829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59eba-49ec-451d-87d7-b86d26faa2a3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:30.661119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59eba-49ec-451d-87d7-b86d26faa2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:30.661404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e59eba-49ec-451d-87d7-b86d26faa2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:30.680178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-13e59eba-49ec-451d-87d7-b86d26faa2a3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:30.681362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-13e59eba-49ec-451d-87d7-b86d26faa2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:30.749182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 442/878] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:30.771258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdd4d0-749b-4383-9910-73a0812798ef None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:30.785195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:30.877417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdd4d0-749b-4383-9910-73a0812798ef None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:30.912875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f95c1-325d-4f7e-a14d-b4f1a99b0fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:30.913883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f95c1-325d-4f7e-a14d-b4f1a99b0fbf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:30.914384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f95c1-325d-4f7e-a14d-b4f1a99b0fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:30.914872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f95c1-325d-4f7e-a14d-b4f1a99b0fbf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:30.915708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f95c1-325d-4f7e-a14d-b4f1a99b0fbf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:30.917270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f95c1-325d-4f7e-a14d-b4f1a99b0fbf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-365f95c1-325d-4f7e-a14d-b4f1a99b0fbf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:30.926626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:30.927617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:30.928433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:30.935954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 437/879] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:30.937771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e59eba-49ec-451d-87d7-b86d26faa2a3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:30.993658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdef37-9ab4-4e26-b05d-5f7b8706c183 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:30.994330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdef37-9ab4-4e26-b05d-5f7b8706c183 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:30.994877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdef37-9ab4-4e26-b05d-5f7b8706c183 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:30.997859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 438/880] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:31.002460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7927a-c805-4cea-b1c3-67224d9d6798 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.002969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7927a-c805-4cea-b1c3-67224d9d6798 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.003527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7927a-c805-4cea-b1c3-67224d9d6798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.022873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-51e7927a-c805-4cea-b1c3-67224d9d6798 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:31.024522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-51e7927a-c805-4cea-b1c3-67224d9d6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:31.032027 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.038927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e59eba-49ec-451d-87d7-b86d26faa2a3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.074463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.074974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.075253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.075530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.076232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:31.076491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.077883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.087237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 443/881] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:31.088990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.107470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 439/882] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:31.130543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7927a-c805-4cea-b1c3-67224d9d6798 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.133999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.204013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81c077-4760-4bc1-92eb-48ff5130efe5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.236456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7927a-c805-4cea-b1c3-67224d9d6798 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.238724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.239355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.239677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.240614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.240614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:31.240902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.242336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.251956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 444/883] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:31.253682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.278653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.279542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.280144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.281649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.282142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.282983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.284660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:31.295025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:31.295982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:31.296804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:31.304674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 440/884] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:31.306174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.359823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd3652-58ef-431f-ab6a-12444d387999 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.376940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.397652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.398312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.398593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.398949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.399708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] RBAC: Adding query filter params (interface=public, service_id=eff8679f6bf54d50a879ecf85261d3eb, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:31.400038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.401506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.412189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 445/885] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/endpoints?service_id=eff8679f6bf54d50a879ecf85261d3eb&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:31.413060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.417312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd717380-38b3-4580-8388-5c9ea6804ec9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.452596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af3d0-badc-4959-a4d6-c3645e5eb63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.453274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af3d0-badc-4959-a4d6-c3645e5eb63e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.453606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af3d0-badc-4959-a4d6-c3645e5eb63e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.453889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af3d0-badc-4959-a4d6-c3645e5eb63e None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.454602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af3d0-badc-4959-a4d6-c3645e5eb63e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:31.454923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af3d0-badc-4959-a4d6-c3645e5eb63e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.456436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af3d0-badc-4959-a4d6-c3645e5eb63e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.461597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 441/886] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:31.467582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33b4c-d03c-4b53-b8e4-71293170f3b2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.467873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33b4c-d03c-4b53-b8e4-71293170f3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.468150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf33b4c-d03c-4b53-b8e4-71293170f3b2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.473804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 442/887] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:31.474775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33b4c-d03c-4b53-b8e4-71293170f3b2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.510820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.526181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39713e4-abc6-40d6-90c7-12c5616e98b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.560167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959af4fe-dcf8-4048-87ed-b6e1a3fadfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.560710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af4fe-dcf8-4048-87ed-b6e1a3fadfed None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.560985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af4fe-dcf8-4048-87ed-b6e1a3fadfed None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.561252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af4fe-dcf8-4048-87ed-b6e1a3fadfed None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.561902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959af4fe-dcf8-4048-87ed-b6e1a3fadfed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.563320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959af4fe-dcf8-4048-87ed-b6e1a3fadfed None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.578883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 446/888] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:08:31.578883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec2b59-388d-41a3-afcb-c96fba63901e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.578883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec2b59-388d-41a3-afcb-c96fba63901e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.578883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec2b59-388d-41a3-afcb-c96fba63901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.594435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-47ec2b59-388d-41a3-afcb-c96fba63901e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:31.596192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47ec2b59-388d-41a3-afcb-c96fba63901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:31.601328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf33b4c-d03c-4b53-b8e4-71293170f3b2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.637303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.642741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.644587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.644979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.645360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.646254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:31.646671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.648256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.656651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 443/889] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:31.663180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.683897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 447/890] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:31.707144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec2b59-388d-41a3-afcb-c96fba63901e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.797647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91831576-2f02-4cd2-b3ba-abb7a2e0cb08 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.811683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.835126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec2b59-388d-41a3-afcb-c96fba63901e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:31.844269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.844917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.845195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.845467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.846775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] RBAC: Adding query filter params (interface=public, service_id=83c7ddb335c142598472499e470e7f28, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:31.847090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.849162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.860543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 444/891] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/endpoints?service_id=83c7ddb335c142598472499e470e7f28&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:31.866225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.876338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:31.877091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:31.877374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:31.878046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:31.878749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:31.880786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:31.891244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:31.892249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:31.893187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 448/892] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:31.900594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:31.966328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:31.996097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e5f17-728b-479a-a2fe-06477c77f20c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:32.009774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cd3a4-e2e4-4b61-9750-bfd6525f7dc2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:32.043160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:32.044044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:32.044309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:32.044584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:32.045276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:32.046668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:32.048862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31eeba0-e495-4b8c-9de1-074de7eb2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:32.050150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eeba0-e495-4b8c-9de1-074de7eb2c31 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:32.050647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eeba0-e495-4b8c-9de1-074de7eb2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:32.051114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31eeba0-e495-4b8c-9de1-074de7eb2c31 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:32.052006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eeba0-e495-4b8c-9de1-074de7eb2c31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:32.052508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eeba0-e495-4b8c-9de1-074de7eb2c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:32.053058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 445/893] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:08:32.054515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31eeba0-e495-4b8c-9de1-074de7eb2c31 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:32.063223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 449/894] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:32.071129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:32.193023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae56f8-b08c-4ac7-b2b0-821552409547 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:32.220143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:32.232502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b3d9-9132-48d7-b5ab-912ddfee18f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:32.233441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b3d9-9132-48d7-b5ab-912ddfee18f5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:32.233945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b3d9-9132-48d7-b5ab-912ddfee18f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:32.234448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b3d9-9132-48d7-b5ab-912ddfee18f5 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:32.235353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b3d9-9132-48d7-b5ab-912ddfee18f5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:32.235858 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b3d9-9132-48d7-b5ab-912ddfee18f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:32.237497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467b3d9-9132-48d7-b5ab-912ddfee18f5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:32.243138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 446/895] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:32.486467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef0e1-e539-49db-aac4-8eb8a7b700ec None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:32.486859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef0e1-e539-49db-aac4-8eb8a7b700ec None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:32.487035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef0e1-e539-49db-aac4-8eb8a7b700ec None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:32.488647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 450/896] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:32.494369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dcbf5-9d80-4a69-8617-575b74d8bf7d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:32.494641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dcbf5-9d80-4a69-8617-575b74d8bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:32.494914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096dcbf5-9d80-4a69-8617-575b74d8bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:32.515515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-096dcbf5-9d80-4a69-8617-575b74d8bf7d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:32.516937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-096dcbf5-9d80-4a69-8617-575b74d8bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:32.586119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 447/897] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:32.608942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef0e1-e539-49db-aac4-8eb8a7b700ec None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:32.621847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:32.716216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef0e1-e539-49db-aac4-8eb8a7b700ec None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:32.751530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:32.752557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:32.753067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:32.753531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:32.771519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:32.776835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:32.777759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:32.778642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:32.781721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 451/898] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 01:08:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:32.788149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096dcbf5-9d80-4a69-8617-575b74d8bf7d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:32.890579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096dcbf5-9d80-4a69-8617-575b74d8bf7d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:32.908898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:32.925600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:32.926383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:32.926670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:32.926948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:32.927735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:32.928411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:32.930156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:32.942251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 448/899] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 01:08:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:32.944443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:33.010798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:33.046761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f428bae-1ea8-403c-a0e0-216fad2cbf4d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:33.080762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:33.081408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.081686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.081974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.092708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:33.094198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:33.108511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:33.109388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:33.110560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:33.110560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:33.110560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:33.110560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:33.110560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 452/900] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:33.115456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:33.226603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd4ef3-1043-4ba8-ae0d-841ca9c42a5a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:33.268859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:33.269842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.270336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.270805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.271685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:33.272171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:33.273737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:33.287156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 449/901] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:33.295644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:33.393842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca1f6-296b-45b0-b0af-8abd703cd805 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:33.414507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:33.428941 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:33.429591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.429871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.430185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.437743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:33.439343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:33.450900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:33.451935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:33.452878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 453/902] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:08:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:33.458710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:33.502126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:33.560797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae0f5b-f11e-4893-bb7a-2d8303db9135 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:33.596866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c9f1-53cd-400c-89c6-32ffc9035814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:33.597531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c9f1-53cd-400c-89c6-32ffc9035814 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.597804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c9f1-53cd-400c-89c6-32ffc9035814 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.598104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c9f1-53cd-400c-89c6-32ffc9035814 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.598901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c9f1-53cd-400c-89c6-32ffc9035814 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:33.599204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c9f1-53cd-400c-89c6-32ffc9035814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:33.600639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c9f1-53cd-400c-89c6-32ffc9035814 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:33.618714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 450/903] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 01:08:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:33.624283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:33.704902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27801db-29da-4ad6-8ad3-bb04818aab37 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.705213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27801db-29da-4ad6-8ad3-bb04818aab37 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.705453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27801db-29da-4ad6-8ad3-bb04818aab37 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.707093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 451/904] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:33.711738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaeb-aa73-47ed-a6a3-cba68c01cc10 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.712113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaeb-aa73-47ed-a6a3-cba68c01cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.712453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9aaeb-aa73-47ed-a6a3-cba68c01cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.726651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438e782-ce18-49b9-b115-5e06f0404a17 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:33.730935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a3f9aaeb-aa73-47ed-a6a3-cba68c01cc10 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:33.732762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a3f9aaeb-aa73-47ed-a6a3-cba68c01cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:33.765706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:33.766464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.766752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.767032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.803973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 452/905] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:33.826648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9aaeb-aa73-47ed-a6a3-cba68c01cc10 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:33.846801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:33.848383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:33.854271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:33.856270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:33.937654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9aaeb-aa73-47ed-a6a3-cba68c01cc10 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:33.974711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:33.975367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:33.975642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:33.975910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:33.976544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:33.977949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:33.985777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 454/906] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:33.988554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:33.989534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:33.990400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 453/907] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:33.997525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.000942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.087211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.108934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124bd1e-ba48-4e1b-a48f-431d304a5c78 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.117271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.129542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64a4ea-077b-4867-a27d-9dad8de46785 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.145500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.146186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.146465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.146735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.147563 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:34.147870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.149354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.157124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 455/908] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:34.161723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.180262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aa251-682e-4077-a8cd-5da516ace47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.181324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa251-682e-4077-a8cd-5da516ace47a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.181839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa251-682e-4077-a8cd-5da516ace47a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.182559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aa251-682e-4077-a8cd-5da516ace47a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.194053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aa251-682e-4077-a8cd-5da516ace47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.195569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aa251-682e-4077-a8cd-5da516ace47a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-288aa251-682e-4077-a8cd-5da516ace47a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:34.210766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:34.211679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:34.212588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:34.212588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:34.212588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:34.212588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:34.212588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 454/909] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:34.213303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74928-d3e9-4afc-b702-35621c118b6e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.213427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74928-d3e9-4afc-b702-35621c118b6e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.213621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d74928-d3e9-4afc-b702-35621c118b6e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.214999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 455/910] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:34.219229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d74928-d3e9-4afc-b702-35621c118b6e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.270284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07f61a-d930-4105-8231-5f39ec8cbf6c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.304119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e04d9-c9e3-464a-a3d4-46daddca2173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.304741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e04d9-c9e3-464a-a3d4-46daddca2173 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.305019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e04d9-c9e3-464a-a3d4-46daddca2173 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.305290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e04d9-c9e3-464a-a3d4-46daddca2173 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.305982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e04d9-c9e3-464a-a3d4-46daddca2173 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:34.306288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e04d9-c9e3-464a-a3d4-46daddca2173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.307662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e04d9-c9e3-464a-a3d4-46daddca2173 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.312593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 456/911] 10.222.0.17 () {56 vars in 1114 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:34.313796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66866bb-eeb0-4b4a-adbe-093df25c7d70 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.314112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66866bb-eeb0-4b4a-adbe-093df25c7d70 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.314411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66866bb-eeb0-4b4a-adbe-093df25c7d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.332424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f66866bb-eeb0-4b4a-adbe-093df25c7d70 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:34.333457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d74928-d3e9-4afc-b702-35621c118b6e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.333897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f66866bb-eeb0-4b4a-adbe-093df25c7d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:34.335720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.372667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.373212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.373501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.373767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.374488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:34.374798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.376190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.388084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 456/912] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:34.388973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.396071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.411042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 457/913] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:34.412186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66866bb-eeb0-4b4a-adbe-093df25c7d70 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.502137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e4a19-29a4-4cdd-8e68-9f57ecfe80f4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.514464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66866bb-eeb0-4b4a-adbe-093df25c7d70 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.536015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.536640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.536912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.537179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.537880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.539276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.550331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a7682-2691-4530-a253-58b7f7a6ad87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.551054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a7682-2691-4530-a253-58b7f7a6ad87 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.551370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a7682-2691-4530-a253-58b7f7a6ad87 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.551675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a7682-2691-4530-a253-58b7f7a6ad87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.559077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a7682-2691-4530-a253-58b7f7a6ad87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.560521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 457/914] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:34.560647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a7682-2691-4530-a253-58b7f7a6ad87 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.561323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.562659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-494a7682-2691-4530-a253-58b7f7a6ad87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:34.575278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:34.576456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:34.577530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:34.581716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 458/915] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:34.583109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b31e-64d4-498f-b1b5-937f4c08857e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.583401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b31e-64d4-498f-b1b5-937f4c08857e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.583683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b31e-64d4-498f-b1b5-937f4c08857e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.585088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 459/916] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:34.585842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b31e-64d4-498f-b1b5-937f4c08857e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.647113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.702994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d8326-321f-4859-a9b3-70b6c91c651a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.704784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b31e-64d4-498f-b1b5-937f4c08857e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.742899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.743706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.743996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.744103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0d0b4-7f41-4fa7-875a-890f68329711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.744264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.744677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0d0b4-7f41-4fa7-875a-890f68329711 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.744961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0d0b4-7f41-4fa7-875a-890f68329711 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.745055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:34.745235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0d0b4-7f41-4fa7-875a-890f68329711 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.745325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.745874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0d0b4-7f41-4fa7-875a-890f68329711 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.747770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0d0b4-7f41-4fa7-875a-890f68329711 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.747873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-54e0d0b4-7f41-4fa7-875a-890f68329711 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:34.757707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:34.758743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 06 01:08:34.759574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:34.761085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 458/917] 10.222.0.17 () {56 vars in 1132 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:34.761085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a204-dc61-422c-aabe-2759f3cc4a14 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.761263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a204-dc61-422c-aabe-2759f3cc4a14 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.761419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6a204-dc61-422c-aabe-2759f3cc4a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.767052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 460/918] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:34.767927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.780190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-46b6a204-dc61-422c-aabe-2759f3cc4a14 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:34.781747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-46b6a204-dc61-422c-aabe-2759f3cc4a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:34.829098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.852105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 459/919] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:34.852955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6a204-dc61-422c-aabe-2759f3cc4a14 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.885613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e6b6-2224-4e3d-b5f1-8d3646a58847 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:34.906864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:34.919583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:34.920205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:34.920481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:34.920938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:34.921419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:34.921768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:34.923127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:34.928131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 461/920] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:34.928796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:34.965605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6a204-dc61-422c-aabe-2759f3cc4a14 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:35.001060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:35.001714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:35.002019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:35.002290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:35.003080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] RBAC: Adding query filter params (role.id=1c300f06fd914d06a9eee875ee14493c, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=77e9dbe99d734b958a5ee8047880c741) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:35.003381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:35.004821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:35.010480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 460/921] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:34 2022] GET /identity/v3/role_assignments?user.id=77e9dbe99d734b958a5ee8047880c741&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1c300f06fd914d06a9eee875ee14493c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:35.011268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:35.058498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbede7-8c26-4c30-8046-0d61b2e34383 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:35.094889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:35.110419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:35.111187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:35.111471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:35.111798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:35.112518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:35.114177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:35.133845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 462/922] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:34 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:35.151236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ed76d-09f7-40c4-b8f3-ce85ca46ceb4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:35.173064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:35.208934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774650dc-c6fb-47eb-ad90-d925fc059099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:35.209585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774650dc-c6fb-47eb-ad90-d925fc059099 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:35.209893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774650dc-c6fb-47eb-ad90-d925fc059099 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:35.210203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774650dc-c6fb-47eb-ad90-d925fc059099 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:35.210914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774650dc-c6fb-47eb-ad90-d925fc059099 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:35.211225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774650dc-c6fb-47eb-ad90-d925fc059099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:35.212665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774650dc-c6fb-47eb-ad90-d925fc059099 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:35.218604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 461/923] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:35.224793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:35.335094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2f519-44d1-4af2-8afe-af87318a0d21 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:35.370874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463564c-9f34-42db-92d2-da5cfa9bbd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:35.371600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463564c-9f34-42db-92d2-da5cfa9bbd9e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:35.371880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463564c-9f34-42db-92d2-da5cfa9bbd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:35.372202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463564c-9f34-42db-92d2-da5cfa9bbd9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:35.372934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463564c-9f34-42db-92d2-da5cfa9bbd9e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:35.374366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463564c-9f34-42db-92d2-da5cfa9bbd9e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:35.405968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 463/924] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:36.645799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098c49-9941-4685-8b46-726269fb4ebc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:36.646363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098c49-9941-4685-8b46-726269fb4ebc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:36.646363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098c49-9941-4685-8b46-726269fb4ebc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:36.647999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 462/925] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:36.653408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815857-3eb1-4fc7-95b1-19c2e20a7d0a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:36.653833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815857-3eb1-4fc7-95b1-19c2e20a7d0a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:36.654025 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd815857-3eb1-4fc7-95b1-19c2e20a7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:36.672999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fd815857-3eb1-4fc7-95b1-19c2e20a7d0a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:36.674318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fd815857-3eb1-4fc7-95b1-19c2e20a7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:36.708235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:36.752364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 464/926] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:36.775214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098c49-9941-4685-8b46-726269fb4ebc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:36.879042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098c49-9941-4685-8b46-726269fb4ebc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:36.914680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:36.915306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:36.915588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:36.915854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:36.916549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:36.918007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:36.920626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING keystone.server.flask.common [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 01:08:36.940426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.sql.core [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 01:08:36.940426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 01:08:36.940426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [parameters: {'id': 'faf50f00b8f348f38cc9fb826ba7fa92', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 01:08:36.940426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80180) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c9036a85-f162-4128-87a0-82a55715f722 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id faf50f00b8f348f38cc9fb826ba7fa92.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id faf50f00b8f348f38cc9fb826ba7fa92. Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:08:36.948388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 06 01:08:36.949199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application yield resource Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise self.value Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application session.commit() Aug 06 01:08:36.950185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.session.flush() Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application compat.raise_( Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 01:08:36.951095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 01:08:36.952018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application result.read() Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:08:36.952828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [parameters: {'id': 'faf50f00b8f348f38cc9fb826ba7fa92', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:36.953692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:36.956304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id faf50f00b8f348f38cc9fb826ba7fa92. Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:36.958379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 463/927] 10.222.0.17 () {60 vars in 1140 bytes} [Sat Aug 6 01:08:36 2022] POST /identity/v3/projects => generated 262 bytes in 175 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:36.959045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815857-3eb1-4fc7-95b1-19c2e20a7d0a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.066371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd815857-3eb1-4fc7-95b1-19c2e20a7d0a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.086248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3e4f-5e85-49e3-a56c-4e70b45c15c7 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.086539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3e4f-5e85-49e3-a56c-4e70b45c15c7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.086797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e3e4f-5e85-49e3-a56c-4e70b45c15c7 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.095033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 464/928] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:37.096314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b37f-690e-4ca6-b804-b3ec477e7d33 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.096597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b37f-690e-4ca6-b804-b3ec477e7d33 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.096874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8049b37f-690e-4ca6-b804-b3ec477e7d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.100583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.101244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.101519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.101788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.108778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:37.110447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:37.118019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8049b37f-690e-4ca6-b804-b3ec477e7d33 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:37.119550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8049b37f-690e-4ca6-b804-b3ec477e7d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:37.121911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:37.123746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:37.124907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 465/929] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:37.130896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.145306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.164338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.197676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 465/930] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:37.212634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1a797-c468-4a96-ab50-d2f24b79aa58 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.212634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1a797-c468-4a96-ab50-d2f24b79aa58 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.212634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1a797-c468-4a96-ab50-d2f24b79aa58 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.212634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 466/931] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:37.219224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf77a6-00d1-42b5-8f97-f3d8c70e7365 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.219224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf77a6-00d1-42b5-8f97-f3d8c70e7365 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.219224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf77a6-00d1-42b5-8f97-f3d8c70e7365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.237747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4dcf77a6-00d1-42b5-8f97-f3d8c70e7365 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:37.239195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4dcf77a6-00d1-42b5-8f97-f3d8c70e7365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:37.255540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b95afa-8d10-4718-9fb7-188af7e3e1de None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.290710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.291338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.291618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.291893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.292676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:37.292980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:37.294470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:37.318053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 466/932] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:37.318233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 467/933] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:37.318328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.333588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf77a6-00d1-42b5-8f97-f3d8c70e7365 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.415868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.436204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba18b6-ca25-4b80-9bb7-9d94a630061c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.438374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.452061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf77a6-00d1-42b5-8f97-f3d8c70e7365 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.483859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.484559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.484840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.485119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.494317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f447cb51-afb2-4539-83f9-e57aaf6c8c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.495194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447cb51-afb2-4539-83f9-e57aaf6c8c43 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.495628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447cb51-afb2-4539-83f9-e57aaf6c8c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.495896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447cb51-afb2-4539-83f9-e57aaf6c8c43 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.496652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447cb51-afb2-4539-83f9-e57aaf6c8c43 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:37.498179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f447cb51-afb2-4539-83f9-e57aaf6c8c43 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:37.500142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f447cb51-afb2-4539-83f9-e57aaf6c8c43 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:37.507696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:37.508674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:37.509507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:37.510303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:37.511124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:37.511956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:37.512636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 468/934] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:37.512636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016004e-6b0d-4141-bbe4-5b227fd47857 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.512759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 467/935] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:37.512834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016004e-6b0d-4141-bbe4-5b227fd47857 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.512834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016004e-6b0d-4141-bbe4-5b227fd47857 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.512834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 469/936] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:37.518285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.519382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016004e-6b0d-4141-bbe4-5b227fd47857 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.624858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36115dfc-984f-4e16-a8aa-5636640c8943 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.630067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016004e-6b0d-4141-bbe4-5b227fd47857 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.662767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4526a70-3537-4927-b3c5-799da7f0ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.663422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4526a70-3537-4927-b3c5-799da7f0ded0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.663680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4526a70-3537-4927-b3c5-799da7f0ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.663957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4526a70-3537-4927-b3c5-799da7f0ded0 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.664685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4526a70-3537-4927-b3c5-799da7f0ded0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:37.664993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4526a70-3537-4927-b3c5-799da7f0ded0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:37.666511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4526a70-3537-4927-b3c5-799da7f0ded0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:37.667352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.667984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.668265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.668541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.669227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:37.669537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:37.670961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:37.680741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 468/937] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:37.680912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 470/938] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:37.680990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19af063-7cb7-4551-8dbf-c2b119674776 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.680990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19af063-7cb7-4551-8dbf-c2b119674776 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.680990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19af063-7cb7-4551-8dbf-c2b119674776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.682982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.692541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.698624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c19af063-7cb7-4551-8dbf-c2b119674776 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:37.699843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c19af063-7cb7-4551-8dbf-c2b119674776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:37.705110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.770288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 469/939] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:37.771246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19af063-7cb7-4551-8dbf-c2b119674776 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.797087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8c25d-c350-4bcd-858a-9c072e55e7f5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.833619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.834289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.834678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.834953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.835755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:37.836062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:37.837440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:37.847727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 471/940] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:37.848431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:37.889740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19af063-7cb7-4551-8dbf-c2b119674776 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.930081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:37.930725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:37.930970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:37.931243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:37.934164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.936521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:37.942854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:37.944322 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:37.957204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f69b05-7ebc-4205-bdfe-b539750a0d5c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:37.959041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:37.959921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:37.960839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:37.960839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:37.960839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:37.960839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:37.960839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 470/941] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:37.961118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.001258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.002242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.002524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.002797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.003680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.004794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:38.014432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:38.017986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:38.018906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 472/942] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:38.019721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.069972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a744bd-252e-4cfa-90e9-e3d6b39ab0f8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.102970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.103571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.103852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.104127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.104890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] RBAC: Adding query filter params (interface=public, service_id=aea7bd57ba8c4ec1ab6767f126837548, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:38.105202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.106624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.112990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 471/943] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:08:37 2022] GET /identity/v3/endpoints?service_id=aea7bd57ba8c4ec1ab6767f126837548&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:38.113803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.142484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f259147-df00-4726-9d19-fc3e11c4a805 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.172695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:38.182497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.183387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.183664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.183931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.184625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:38.184927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.186954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.205808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 473/944] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:38.205808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.217106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:38.219510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a7789-7f8c-400d-b08a-37bb0434215e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.255825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.256505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.256738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.257012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.257727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:38.258015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.259416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.269105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 472/945] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:38.269105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.315690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0e170-bd19-46f6-a135-b719ebd9f3d3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.351621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.352490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.352907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.353316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.354256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.355760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.362574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 474/946] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:08:38.363600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.374075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a916b77-56c6-493e-bb5c-ab71e44497bc None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.393345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:38.414626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.415297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.415579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.415855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.425900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.427468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:38.440544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:38.441569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:38.443063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 473/947] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:38.447619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.498329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:38.524429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c592faf-8b8f-4cba-bbc6-ebea76adbdf9 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.575651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.576674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.577165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.577631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.578545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:38.579046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.580679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.585259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c676e-bd2c-45af-9d94-5e343244cd02 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.594049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 475/948] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:38.623641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.624289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.624641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.624917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.625741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:38.626088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.627639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.648763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 474/949] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:38.654304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.779195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56685d9c-0e32-4032-bad0-8dd8c000c94e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.814965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.815623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.815906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.816184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.818393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:38.828533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:38.830632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:38.845967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:38.846926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:38.848238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:38.848238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:38.848238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:38.848238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:38.848238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 476/950] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:38.853257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:38.893938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:38.961819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37a2c1-5c52-4654-9c6c-43153b26c8ba None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:38.997704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:38.998366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:38.998645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:38.998916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:38.999674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:38.999980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:39.001449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:39.014301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 475/951] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:39.020085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:39.128013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7557058-7ea1-47fe-98de-b448d2603b24 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:39.163271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:39.163929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:39.164207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:39.164480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:39.171837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:39.173342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:39.185131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:39.186058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:39.187369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 477/952] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:39.192579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:39.296435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:39.304988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cf935-a04c-43f3-a3ba-7475b24b3a30 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:39.341301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef392732-0435-406a-a103-f193ba74ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:39.341953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392732-0435-406a-a103-f193ba74ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:39.342250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392732-0435-406a-a103-f193ba74ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:39.342525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef392732-0435-406a-a103-f193ba74ac54 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:39.343284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef392732-0435-406a-a103-f193ba74ac54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:39.343593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef392732-0435-406a-a103-f193ba74ac54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:39.345054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef392732-0435-406a-a103-f193ba74ac54 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:39.358928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 476/953] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:39.366226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:39.378721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887867e-7284-4954-a000-e6ed2ad16b0d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:39.379036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887867e-7284-4954-a000-e6ed2ad16b0d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:39.379294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887867e-7284-4954-a000-e6ed2ad16b0d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:39.381009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 477/954] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:39.386061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c49b2-fcda-435b-ac64-b8c7ffaf5115 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:39.386350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c49b2-fcda-435b-ac64-b8c7ffaf5115 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:39.386624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c49b2-fcda-435b-ac64-b8c7ffaf5115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:39.404783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c75c49b2-fcda-435b-ac64-b8c7ffaf5115 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:39.406371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c75c49b2-fcda-435b-ac64-b8c7ffaf5115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:39.420499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:39.484728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37fbc-a4f4-423d-932c-f975d72ecd3a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:39.486242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 478/955] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:39.503300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c49b2-fcda-435b-ac64-b8c7ffaf5115 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:39.533370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:39.534200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:39.534506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:39.534789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/77e9dbe99d734b958a5ee8047880c741/roles/1c300f06fd914d06a9eee875ee14493c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:39.537163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=77e9dbe99d734b958a5ee8047880c741, role_id=1c300f06fd914d06a9eee875ee14493c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:39.538747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:39.562106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 478/956] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:39 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/77e9dbe99d734b958a5ee8047880c741/roles/1c300f06fd914d06a9eee875ee14493c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:39.604557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:39.622466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c49b2-fcda-435b-ac64-b8c7ffaf5115 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:39.660963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:39.661608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:39.661888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:39.662197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:39.662908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:39.664420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:39.667294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING keystone.server.flask.common [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 06 01:08:39.692247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.sql.core [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 01:08:39.692247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 01:08:39.692247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [parameters: {'user_id': '52fa583fa328471f9c837581c831eaef', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 01:08:39.692247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80181) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Aug 06 01:08:39.708463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:08:39.709507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application yield resource Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application next(self.gen) Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.rollback() Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.force_reraise() Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise self.value Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application session.commit() Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 06 01:08:39.710556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._prepare_impl() Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.session.flush() Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._flush(objects) Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application compat.raise_( Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application flush_context.execute() Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rec.execute(self) Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 06 01:08:39.712747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 06 01:08:39.715501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result = self._query(query) Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application conn.query(q) Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application result.read() Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 06 01:08:39.717551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [parameters: {'user_id': '52fa583fa328471f9c837581c831eaef', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:39.719473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 06 01:08:39.727046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 06 01:08:39.729207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 06 01:08:39.729207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 06 01:08:39.729207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 06 01:08:39.729207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 06 01:08:39.729207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 06 01:08:39.729207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:39.729207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 479/957] 10.222.0.17 () {60 vars in 1131 bytes} [Sat Aug 6 01:08:39 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:39.730162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:39.831990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c8d04-aae8-4375-ac79-8c5e40b879a2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:39.841088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:39.871313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa681402-09e0-413e-b6de-b88671101994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:39.872059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681402-09e0-413e-b6de-b88671101994 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:39.872339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681402-09e0-413e-b6de-b88671101994 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:39.872657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa681402-09e0-413e-b6de-b88671101994 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:39.880282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa681402-09e0-413e-b6de-b88671101994 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:39.881770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa681402-09e0-413e-b6de-b88671101994 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fa681402-09e0-413e-b6de-b88671101994 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:39.893593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:39.894622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:39.895628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 479/958] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:39.901350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:40.007691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ac2c8-bfc2-4d25-a45c-bbb1a077edac None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:40.043523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c910944-41fe-4643-8d80-46815db77e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:40.044740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c910944-41fe-4643-8d80-46815db77e4c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.045183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c910944-41fe-4643-8d80-46815db77e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.045668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c910944-41fe-4643-8d80-46815db77e4c None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.046713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c910944-41fe-4643-8d80-46815db77e4c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:40.047194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c910944-41fe-4643-8d80-46815db77e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:40.049057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c910944-41fe-4643-8d80-46815db77e4c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:40.088513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 480/959] 10.222.0.17 () {56 vars in 1101 bytes} [Sat Aug 6 01:08:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:40.503130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b54ce-f7c9-4532-992b-9f49b7fd38ee None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.503130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b54ce-f7c9-4532-992b-9f49b7fd38ee None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.503130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b54ce-f7c9-4532-992b-9f49b7fd38ee None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.504520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 480/960] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:40.509900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046afe-6f40-46d2-9e1c-23c0fd606c9e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.510426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046afe-6f40-46d2-9e1c-23c0fd606c9e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.510704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60046afe-6f40-46d2-9e1c-23c0fd606c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.518485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:40.531594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-60046afe-6f40-46d2-9e1c-23c0fd606c9e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:40.534172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-60046afe-6f40-46d2-9e1c-23c0fd606c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:40.603893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 481/961] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:40.626218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b54ce-f7c9-4532-992b-9f49b7fd38ee None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:40.717562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187e5a-fd92-4410-bf0e-e7a82c441528 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.717854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187e5a-fd92-4410-bf0e-e7a82c441528 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.718159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04187e5a-fd92-4410-bf0e-e7a82c441528 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.719591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 482/962] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:40.724448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52ddb-7ba3-4f00-8ef2-4827bfe931aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.724736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52ddb-7ba3-4f00-8ef2-4827bfe931aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.725030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc52ddb-7ba3-4f00-8ef2-4827bfe931aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.736672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b54ce-f7c9-4532-992b-9f49b7fd38ee None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:40.745206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ffc52ddb-7ba3-4f00-8ef2-4827bfe931aa None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:40.746403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ffc52ddb-7ba3-4f00-8ef2-4827bfe931aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:40.772318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:40.772885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.773166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.773430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.774094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:40.775477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:40.784783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:40.785866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:40.786760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 481/963] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:40.791834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:40.821126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 483/964] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:40.825773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:40.843280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52ddb-7ba3-4f00-8ef2-4827bfe931aa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:40.902214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f7b8-2a5a-44e1-b3eb-807dc845fedb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:40.903207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:40.942706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:40.943323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.943599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.943867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.944472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc52ddb-7ba3-4f00-8ef2-4827bfe931aa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:40.944922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:40.945228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:40.947309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:40.951816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 482/965] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:40.957311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:40.980850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:40.981538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:40.981827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:40.982119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:40.982825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:40.984219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:41.001960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 484/966] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:40 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:08:41.065395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:41.074411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916068e4-9477-4f81-8e5e-33c5505a848f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:41.119859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd86fb-d0d8-46b2-af8e-852fef8772fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:41.120578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd86fb-d0d8-46b2-af8e-852fef8772fe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:41.120849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd86fb-d0d8-46b2-af8e-852fef8772fe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:41.121199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd86fb-d0d8-46b2-af8e-852fef8772fe None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:41.121890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd86fb-d0d8-46b2-af8e-852fef8772fe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:41.122218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd86fb-d0d8-46b2-af8e-852fef8772fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:41.123597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd86fb-d0d8-46b2-af8e-852fef8772fe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:41.129554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 483/967] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:41.135332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:41.238822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa3aeb2-1a26-430a-ac71-a5f1980e4746 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:41.261970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:41.274964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d7cba-8105-462f-856e-a032af55eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:41.275604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7cba-8105-462f-856e-a032af55eafa None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:41.275886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7cba-8105-462f-856e-a032af55eafa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:41.276162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d7cba-8105-462f-856e-a032af55eafa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:41.276874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d7cba-8105-462f-856e-a032af55eafa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:41.278316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d7cba-8105-462f-856e-a032af55eafa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:41.299682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 485/968] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:41.697339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e64193-4560-427c-93e3-4bf5272bbc86 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:41.697583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e64193-4560-427c-93e3-4bf5272bbc86 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:41.697852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e64193-4560-427c-93e3-4bf5272bbc86 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:41.699458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 484/969] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:41.704681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73743dd-30a7-457a-9b5c-15338d589577 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:41.704946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73743dd-30a7-457a-9b5c-15338d589577 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:41.705252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73743dd-30a7-457a-9b5c-15338d589577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:41.725283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d73743dd-30a7-457a-9b5c-15338d589577 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:41.726510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d73743dd-30a7-457a-9b5c-15338d589577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:41.804052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 486/970] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:41.826891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e64193-4560-427c-93e3-4bf5272bbc86 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:41.932884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e64193-4560-427c-93e3-4bf5272bbc86 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:41.968137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:41.968781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:41.969052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:41.969290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:41.979966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:41.984924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:41.986240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:41.987133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 485/971] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 01:08:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:41.994101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73743dd-30a7-457a-9b5c-15338d589577 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:42.095117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73743dd-30a7-457a-9b5c-15338d589577 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:42.102347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:42.132939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:42.133572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:42.133852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:42.134151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:42.134877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:42.135184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:42.136570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:42.145116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 487/972] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 01:08:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:42.150723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:42.169288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:42.256952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93607d89-2058-4055-a5f7-c04171990772 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:42.291244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:42.291917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:42.292191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:42.292461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:42.302673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:42.304126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:42.318647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:42.319556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:42.320478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:42.320478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:42.320478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:42.320478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:42.322251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 486/973] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:42.325495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:42.429673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ceaac-e82e-46be-b8a2-06e50f49f857 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:42.463144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:42.463772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:42.464052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:42.464320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:42.465016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:42.465322 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:42.466779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:42.479172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 488/974] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:42.484690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:42.557197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:42.594186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907a2386-8338-4dbe-8157-5e75b3ce0a37 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:42.628406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:42.629049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:42.629328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:42.629599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:42.637860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:42.639346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:42.650460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:42.651379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 06 01:08:42.652334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:42.653997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 487/975] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:08:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:42.657819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:42.688202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:42.764848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f0c2b-d604-4b9d-a14a-60e5b3948b2e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:42.800459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa0e4-228c-4e81-8e80-70d35cfad1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:42.801084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa0e4-228c-4e81-8e80-70d35cfad1eb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:42.801373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa0e4-228c-4e81-8e80-70d35cfad1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:42.801629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa0e4-228c-4e81-8e80-70d35cfad1eb None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:42.802460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa0e4-228c-4e81-8e80-70d35cfad1eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:42.802766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa0e4-228c-4e81-8e80-70d35cfad1eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:42.804206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa0e4-228c-4e81-8e80-70d35cfad1eb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:42.821543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 489/976] 10.222.0.17 () {56 vars in 1149 bytes} [Sat Aug 6 01:08:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:42.827292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:42.932311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e9f47-65eb-459e-a539-2c8d71f1ad09 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:42.958015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:42.968826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:42.969466 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:42.969742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:42.970088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.009083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87d41-82df-42b3-9ab1-7c1458cad5b4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.009609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87d41-82df-42b3-9ab1-7c1458cad5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.009609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce87d41-82df-42b3-9ab1-7c1458cad5b4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.011222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 490/977] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:43.015856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695e78-bf3b-4ecd-be65-aeed3f71cfa5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.016134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695e78-bf3b-4ecd-be65-aeed3f71cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.016423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0695e78-bf3b-4ecd-be65-aeed3f71cfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.035242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b0695e78-bf3b-4ecd-be65-aeed3f71cfa5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:43.036823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b0695e78-bf3b-4ecd-be65-aeed3f71cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:43.041495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.043480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.110140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 491/978] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:43.131952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0695e78-bf3b-4ecd-be65-aeed3f71cfa5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.150288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.157943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 488/979] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:42 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:43.160111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.187530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.238809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0695e78-bf3b-4ecd-be65-aeed3f71cfa5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.265968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d9c0e-020d-4c1f-b140-bff7cd81b05d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.274180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7b66c-e862-4ab7-bc57-9a0a1e975cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.274842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b66c-e862-4ab7-bc57-9a0a1e975cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.275096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b66c-e862-4ab7-bc57-9a0a1e975cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.275437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7b66c-e862-4ab7-bc57-9a0a1e975cd4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.276072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7b66c-e862-4ab7-bc57-9a0a1e975cd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.277457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7b66c-e862-4ab7-bc57-9a0a1e975cd4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d3f7b66c-e862-4ab7-bc57-9a0a1e975cd4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:43.286531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:43.287616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:43.288465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 492/980] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:43.289285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b647ba-3559-475d-8b6d-8307c44ab61d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.289285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b647ba-3559-475d-8b6d-8307c44ab61d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.289417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b647ba-3559-475d-8b6d-8307c44ab61d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.290679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 493/981] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:43.293430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b647ba-3559-475d-8b6d-8307c44ab61d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.306181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017b593-8ed0-4852-842f-0e7a128797ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.306823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017b593-8ed0-4852-842f-0e7a128797ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.307102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017b593-8ed0-4852-842f-0e7a128797ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.307370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017b593-8ed0-4852-842f-0e7a128797ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.317303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017b593-8ed0-4852-842f-0e7a128797ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.318786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017b593-8ed0-4852-842f-0e7a128797ea None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-1017b593-8ed0-4852-842f-0e7a128797ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:43.333331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:43.334353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:43.335286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:43.335286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:43.335286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:43.335286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:43.335286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 489/982] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:43.335743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199485bf-609a-467a-a1ba-b08afdd58bf9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.336008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199485bf-609a-467a-a1ba-b08afdd58bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.336209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199485bf-609a-467a-a1ba-b08afdd58bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.353697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-199485bf-609a-467a-a1ba-b08afdd58bf9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:43.354933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-199485bf-609a-467a-a1ba-b08afdd58bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:43.380906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.401073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b647ba-3559-475d-8b6d-8307c44ab61d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.421943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 490/983] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:43.422895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199485bf-609a-467a-a1ba-b08afdd58bf9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.434256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.434874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.435152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.435423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.436093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:43.436394 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.437769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.442714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 494/984] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:43.444232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.452425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.543960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277c545-3f5e-45fe-983e-c230d8e0942d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.547080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199485bf-609a-467a-a1ba-b08afdd58bf9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.576986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.577622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.577898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.578193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.578814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.580225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.580897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.581528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.581809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.582176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.582813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:43.583122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.584486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:43.588779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:43.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:43.590790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 495/985] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:43.591596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.597317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 491/986] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:43.598062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.608552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.663279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.696484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66005c88-08b2-4bfd-b4fc-b6c06d6773df None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.697621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59313cb-9e28-4ee6-b4e9-e23660f803fb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.730582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.731199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.731441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.731553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.731737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.732065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.732350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.732451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:43.732621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.732712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.733296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:43.733601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.734117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.734976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.738901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 496/987] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:43.739664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.744875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 492/988] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:43.744875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.815379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.845074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35cefa-2b65-4c28-8db7-dfba219b9bca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.845806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629d2a-8ea8-4443-80a4-ced0d4309a66 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.872436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:43.877573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.877882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:43.878308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.878535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:43.878634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.878817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:43.878934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.879087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:43.879845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] RBAC: Adding query filter params (interface=public, service_id=8113e8bd16ab4b1593aa63ef3f157968, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:43.880154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.881530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.885504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:43.886581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 493/989] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/endpoints?service_id=8113e8bd16ab4b1593aa63ef3f157968&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:43.886969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:43.887348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:43.898583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:43.899629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 497/990] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:43.900555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:43.989518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c2f6e-64d0-4795-8f25-1ad2e144c85a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:43.998576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da7551-b577-4e0d-be23-0fd126c7c9b4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:44.021703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:44.022357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:44.022635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:44.022901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:44.023582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:44.023884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:44.025304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:44.026162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:44.031236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 494/991] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:44.031903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:44.034685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:44.035307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:44.035564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:44.035835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:44.036484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:44.037865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:44.044367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 498/992] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:43 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:08:44.044970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:44.099807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:44.146967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a61fe3-88de-4ca8-bff4-ea3451b82998 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:44.159371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44169e0f-dec5-4f61-80b1-b6602b32e9a4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:44.185509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:44.186287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:44.186565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:44.186850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:44.187601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:44.187906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:44.189415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:44.197270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:44.197905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:44.198219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:44.198500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:44.199266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] RBAC: Adding query filter params (interface=admin, service_id=aea7bd57ba8c4ec1ab6767f126837548, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:44.199575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:44.200964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:44.203320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 495/993] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:44.210055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:44.212474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 499/994] 10.222.0.17 () {56 vars in 1249 bytes} [Sat Aug 6 01:08:44 2022] GET /identity/v3/endpoints?service_id=aea7bd57ba8c4ec1ab6767f126837548&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:44.217787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:44.279221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:44.321605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e3cd-33e2-4544-afa9-c0ebff80ac98 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:44.324082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f830e-0251-41fc-81b9-347b25998c3c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:44.343012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:44.358355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4242f92-199e-4e49-ac26-4e8c0cc0e8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:44.358909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4242f92-199e-4e49-ac26-4e8c0cc0e8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:44.359227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4242f92-199e-4e49-ac26-4e8c0cc0e8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:44.359389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfc9bd-1e4d-4745-847e-1d6d321a4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:44.359500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4242f92-199e-4e49-ac26-4e8c0cc0e8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:44.360275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc9bd-1e4d-4745-847e-1d6d321a4240 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:44.360382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4242f92-199e-4e49-ac26-4e8c0cc0e8c3 None admin] RBAC: Adding query filter params (role.id=1c300f06fd914d06a9eee875ee14493c, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=77e9dbe99d734b958a5ee8047880c741) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:44.360576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc9bd-1e4d-4745-847e-1d6d321a4240 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:44.360673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4242f92-199e-4e49-ac26-4e8c0cc0e8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:44.360841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfc9bd-1e4d-4745-847e-1d6d321a4240 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:44.361493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfc9bd-1e4d-4745-847e-1d6d321a4240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:44.362091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4242f92-199e-4e49-ac26-4e8c0cc0e8c3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:44.362903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfc9bd-1e4d-4745-847e-1d6d321a4240 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:44.374059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 496/995] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:44 2022] GET /identity/v3/role_assignments?user.id=77e9dbe99d734b958a5ee8047880c741&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1c300f06fd914d06a9eee875ee14493c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:44.374299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 500/996] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:44 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:08:46.054915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51b55-7445-401f-b35a-5aae8f786d21 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.055470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51b55-7445-401f-b35a-5aae8f786d21 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.055470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51b55-7445-401f-b35a-5aae8f786d21 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.057010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 497/997] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:46.062238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25e98b-72d1-4cde-8901-9003e53b29fe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.062684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25e98b-72d1-4cde-8901-9003e53b29fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.062762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25e98b-72d1-4cde-8901-9003e53b29fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.081749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4d25e98b-72d1-4cde-8901-9003e53b29fe None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:46.083029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4d25e98b-72d1-4cde-8901-9003e53b29fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:46.151856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 501/998] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:46.174800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51b55-7445-401f-b35a-5aae8f786d21 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.284347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51b55-7445-401f-b35a-5aae8f786d21 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.318492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d777e5-7460-477a-8f31-d4553f28251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:46.319061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d777e5-7460-477a-8f31-d4553f28251c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.319338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d777e5-7460-477a-8f31-d4553f28251c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.319612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d777e5-7460-477a-8f31-d4553f28251c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.320241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d777e5-7460-477a-8f31-d4553f28251c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:46.321620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d777e5-7460-477a-8f31-d4553f28251c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-80d777e5-7460-477a-8f31-d4553f28251c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:46.330658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:46.331678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:46.332569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 498/999] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:46.339890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25e98b-72d1-4cde-8901-9003e53b29fe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.364564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3fd70-2ee7-4dac-8330-d025cd36e469 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.365249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3fd70-2ee7-4dac-8330-d025cd36e469 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.365575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3fd70-2ee7-4dac-8330-d025cd36e469 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.367000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 499/1000] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:46.372666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c5f5-8f9b-4ce3-bb25-e64a6749861a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.373086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c5f5-8f9b-4ce3-bb25-e64a6749861a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.373359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4c5f5-8f9b-4ce3-bb25-e64a6749861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.391180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1db4c5f5-8f9b-4ce3-bb25-e64a6749861a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:46.392424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1db4c5f5-8f9b-4ce3-bb25-e64a6749861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:46.397386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:46.436419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:46.440694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25e98b-72d1-4cde-8901-9003e53b29fe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.461095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 500/1001] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:46.462371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8660ab-58b3-4610-a0fe-27f99518269b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.462654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8660ab-58b3-4610-a0fe-27f99518269b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.462929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8660ab-58b3-4610-a0fe-27f99518269b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.464172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 501/1002] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:46.470087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb3411-392b-47a6-a007-d7ca7fcdb076 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.470374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb3411-392b-47a6-a007-d7ca7fcdb076 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.470651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb3411-392b-47a6-a007-d7ca7fcdb076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.474087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:46.474714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.474990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.475257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.475962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:46.476263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:46.477649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:46.482554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 502/1003] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:46.483367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.490351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-69bb3411-392b-47a6-a007-d7ca7fcdb076 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:46.491539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-69bb3411-392b-47a6-a007-d7ca7fcdb076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:46.559000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 502/1004] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:46.559876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb3411-392b-47a6-a007-d7ca7fcdb076 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.590259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1dc199-50ef-4e59-8e21-f1d1232cc41b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.606878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:46.623968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:46.624614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.624896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.625169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.625804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:46.627427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:46.636199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:46.637207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:46.638089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 503/1005] 10.222.0.17 () {56 vars in 1126 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:46.638885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.659305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb3411-392b-47a6-a007-d7ca7fcdb076 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.668599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:46.693971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:46.694632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.694911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.695183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.695871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:46.696176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:46.697555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:46.702485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 503/1006] 10.222.0.17 () {56 vars in 1112 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:46.703243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.740688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639904d3-927b-4e20-b4fa-cf01e373fc73 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.774113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:46.774750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.775026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.775294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.775918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:46.777299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:46.786373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:46.787593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:46.788610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 504/1007] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:46.789613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.806942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656d7ae-2bc8-4bf9-a79d-ad7e38f7f470 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.833769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:46.840772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:46.841338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.841614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.841888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.842601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:46.842907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:46.844295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:46.849081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 504/1008] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:46.849841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:46.883745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:46.892338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20db35f-0ec1-426f-bfb2-a96e47031596 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.925901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:46.926552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:46.926835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:46.927114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:46.927821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:46.929230 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:46.949706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d46b3-4aa0-4efc-89b9-26ae330b3af1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:46.961892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 505/1009] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:46.961892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:47.000826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:47.001626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:47.001992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:47.002331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:47.003098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] RBAC: Adding query filter params (name=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:47.003468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:47.004898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:47.010608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 505/1010] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:47.016052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:47.072263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc645296-91d7-422f-8655-d5fe103017e2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:47.074150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:47.114583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:47.115454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:47.115900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:47.116174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:47.116856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:47.117158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:47.118566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:47.120754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:47.126414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 506/1011] 10.222.0.17 () {56 vars in 1122 bytes} [Sat Aug 6 01:08:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:47.127605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de41b-4300-4e17-8d81-f7d99f5fdf6e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:47.131472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:47.166876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f9dbb-f7c2-47e7-97d5-6aec1b7fba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:47.167505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f9dbb-f7c2-47e7-97d5-6aec1b7fba62 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:47.167780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f9dbb-f7c2-47e7-97d5-6aec1b7fba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:47.168052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f9dbb-f7c2-47e7-97d5-6aec1b7fba62 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:47.168732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f9dbb-f7c2-47e7-97d5-6aec1b7fba62 None admin] RBAC: Adding query filter params (type=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:47.169033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f9dbb-f7c2-47e7-97d5-6aec1b7fba62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:47.170432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f9dbb-f7c2-47e7-97d5-6aec1b7fba62 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:47.176656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 506/1012] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:47.249634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b049c87-079f-4c63-b1fb-15ffa48050ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:47.289025 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4f9c0-392c-4d51-a873-63925699856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:47.289664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f9c0-392c-4d51-a873-63925699856e None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:47.289959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f9c0-392c-4d51-a873-63925699856e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:47.290253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4f9c0-392c-4d51-a873-63925699856e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:47.290982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f9c0-392c-4d51-a873-63925699856e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:47.292414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4f9c0-392c-4d51-a873-63925699856e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:47.312042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 507/1013] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:08:49.063153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6221-21e4-4760-a42d-b616fb8549ab None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.063845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6221-21e4-4760-a42d-b616fb8549ab None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.063845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6221-21e4-4760-a42d-b616fb8549ab None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.065305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 507/1014] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:49.070439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ac3d-0e9c-46c2-b5ee-c87d1ece4466 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.070847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ac3d-0e9c-46c2-b5ee-c87d1ece4466 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.071014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7ac3d-0e9c-46c2-b5ee-c87d1ece4466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.089814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4cf7ac3d-0e9c-46c2-b5ee-c87d1ece4466 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:49.091032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4cf7ac3d-0e9c-46c2-b5ee-c87d1ece4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:49.112667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:49.146340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e79ac-8e2d-4ce2-a82b-de557c7e4b8f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.146674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e79ac-8e2d-4ce2-a82b-de557c7e4b8f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.146873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e79ac-8e2d-4ce2-a82b-de557c7e4b8f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.148576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 508/1015] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:49.153881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68af93-1a6a-4137-9a91-4271d1f9617e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.154186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68af93-1a6a-4137-9a91-4271d1f9617e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.154455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68af93-1a6a-4137-9a91-4271d1f9617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.170627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 508/1016] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:49.175172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cd68af93-1a6a-4137-9a91-4271d1f9617e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:49.176382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cd68af93-1a6a-4137-9a91-4271d1f9617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:49.196146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ac3d-0e9c-46c2-b5ee-c87d1ece4466 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.243959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 509/1017] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:49.265911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68af93-1a6a-4137-9a91-4271d1f9617e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.299046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7ac3d-0e9c-46c2-b5ee-c87d1ece4466 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:49.334860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452879d-291c-4792-86eb-b24487d3b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:49.335417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452879d-291c-4792-86eb-b24487d3b27c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.335694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452879d-291c-4792-86eb-b24487d3b27c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.335966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452879d-291c-4792-86eb-b24487d3b27c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.346399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452879d-291c-4792-86eb-b24487d3b27c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7452879d-291c-4792-86eb-b24487d3b27c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:49.351365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:49.352456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:49.353420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 509/1018] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 01:08:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:49.354294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda595a-1a57-4ed0-b79d-d15f657b0473 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.354540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda595a-1a57-4ed0-b79d-d15f657b0473 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.354800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda595a-1a57-4ed0-b79d-d15f657b0473 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.356033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 510/1019] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:49.358722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda595a-1a57-4ed0-b79d-d15f657b0473 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.361987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:49.371929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68af93-1a6a-4137-9a91-4271d1f9617e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:49.373849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:49.405532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31337c3d-b3f8-4311-8b83-4a6a07635aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:49.406179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337c3d-b3f8-4311-8b83-4a6a07635aef None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.406446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337c3d-b3f8-4311-8b83-4a6a07635aef None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.406731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31337c3d-b3f8-4311-8b83-4a6a07635aef None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.407429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31337c3d-b3f8-4311-8b83-4a6a07635aef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:49.408797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31337c3d-b3f8-4311-8b83-4a6a07635aef None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:49.423665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 510/1020] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:49 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:08:49.424836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686482-aab6-495a-8739-685b722439d8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.425114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686482-aab6-495a-8739-685b722439d8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.425381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29686482-aab6-495a-8739-685b722439d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.444013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-29686482-aab6-495a-8739-685b722439d8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:49.445342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-29686482-aab6-495a-8739-685b722439d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:49.472702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda595a-1a57-4ed0-b79d-d15f657b0473 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:49.516605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:49.517348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.517630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.517905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.518682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:49.518988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:49.520424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:49.527997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 511/1021] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:49.530497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 511/1022] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 01:08:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:49.535829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.551929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686482-aab6-495a-8739-685b722439d8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.623275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:49.643173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:49.656196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f87fd0-a74d-499b-94f0-e1a20c124fa4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:49.668009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29686482-aab6-495a-8739-685b722439d8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:49.691292 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:49.691945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.692226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.692490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.703170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:49.704135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:49.704680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:49.704784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.705070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.705314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.706494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:49.707914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:49.709680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 512/1023] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:49.715293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:49.719202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:49.720206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:49.721093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:49.721093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:49.721093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:49.721093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:49.721093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 512/1024] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:49.725986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.826894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cdaa0-7419-4fb2-a491-32e85a5e33d8 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:49.828280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51369-0a40-4c9b-a8a6-40d039761722 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:49.851187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:49.865851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:49.866053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:49.866637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.866923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.867145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:49.867262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.867659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:49.867884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:49.868193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:49.868356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:49.869166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:49.869576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:49.871035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:49.886294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 513/1025] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:49.887693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:49.896164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:49.910216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 513/1026] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:08:49 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:08:50.010892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e0a6-d1fc-47ad-a26f-d2e0c2fcb60b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:50.048190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:50.048949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:50.049227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:50.049492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:50.057564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:50.059202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:50.071372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:50.072905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:50.074115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 514/1027] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:08:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:50.080629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:50.185900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d562c-a0e9-4a11-9f42-87435393e819 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:50.220871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:50.221847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:50.222285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:50.222714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:50.223789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:50.224321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:50.225897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:50.243897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 514/1028] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:08:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:50.250244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:50.296244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:50.355831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b1023-48c0-4ebc-8ed0-bed667d76b34 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:50.388926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:50.389551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:50.389831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:50.390127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:50.457800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:50.459234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:50.505689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:50.568164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 515/1029] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:50.569532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:50.631623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:50.676598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bb701-c25b-42dd-af57-49ef43c819c5 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:50.710850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:50.711416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:50.711693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:50.711962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:50.721954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:50.723400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:50.738133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:50.739034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:50.740019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:50.740019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:50.740019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:50.740019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:50.740019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 515/1030] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:50.746264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:50.845125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1cd95-b0d4-4732-9c36-ca0bd8d2b32f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:50.878511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:50.879137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:50.879413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:50.879678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:50.880360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:50.880666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:50.882084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:50.897956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 516/1031] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:50.899754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:51.004080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3c4e-cb67-48b9-999e-bdb5d93e2804 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:51.015111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:51.040701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:51.041424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.041705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.042080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.050191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:51.051720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:51.065383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:51.066574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:51.068008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:51.070278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 516/1032] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:51.072419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:51.075509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:51.175719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee7f2a-5a85-4bdd-a389-c6ecfd11f5c8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:51.208835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a277fe-dad6-4385-96ed-aaf35758c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:51.209465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a277fe-dad6-4385-96ed-aaf35758c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.209746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a277fe-dad6-4385-96ed-aaf35758c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.210129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a277fe-dad6-4385-96ed-aaf35758c8a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.210882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a277fe-dad6-4385-96ed-aaf35758c8a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:51.211189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a277fe-dad6-4385-96ed-aaf35758c8a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:51.212675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a277fe-dad6-4385-96ed-aaf35758c8a5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:51.224814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 517/1033] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:51.230718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:51.329892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37000c24-4660-401f-bf05-c263b4f546da None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:51.363215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad02899-fbb2-457e-9d43-810bcb29ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:51.363854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02899-fbb2-457e-9d43-810bcb29ec25 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.364137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02899-fbb2-457e-9d43-810bcb29ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.364406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad02899-fbb2-457e-9d43-810bcb29ec25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.365200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02899-fbb2-457e-9d43-810bcb29ec25 None admin] RBAC: Adding query filter params (role.id=1c300f06fd914d06a9eee875ee14493c, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=2d0553dc133749eab4777d6552a93178) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:51.365509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02899-fbb2-457e-9d43-810bcb29ec25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:51.366976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad02899-fbb2-457e-9d43-810bcb29ec25 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:51.372882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 517/1034] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:51 2022] GET /identity/v3/role_assignments?user.id=2d0553dc133749eab4777d6552a93178&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1c300f06fd914d06a9eee875ee14493c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:51.442437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcd6f1-452e-47ba-be11-8ea937db53e1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.442786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcd6f1-452e-47ba-be11-8ea937db53e1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.442976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dcd6f1-452e-47ba-be11-8ea937db53e1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.444410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 518/1035] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:51.450316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2798f6-f0ec-4540-8af5-73ea41f80768 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.450638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2798f6-f0ec-4540-8af5-73ea41f80768 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.450858 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2798f6-f0ec-4540-8af5-73ea41f80768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.470743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6c2798f6-f0ec-4540-8af5-73ea41f80768 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:51.471977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6c2798f6-f0ec-4540-8af5-73ea41f80768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:51.510553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:51.557357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 518/1036] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:51.579983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcd6f1-452e-47ba-be11-8ea937db53e1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:51.644604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:51.689245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dcd6f1-452e-47ba-be11-8ea937db53e1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:51.725616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:51.726295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.726576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.726856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.727464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:51.728872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:51.738109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:51.739075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:51.745184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 519/1037] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Aug 6 01:08:51 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:51.747699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2798f6-f0ec-4540-8af5-73ea41f80768 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:51.851680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2798f6-f0ec-4540-8af5-73ea41f80768 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:51.887526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf049b-fd5a-41ec-9e0b-f377854ff059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:51.888167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf049b-fd5a-41ec-9e0b-f377854ff059 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.888443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf049b-fd5a-41ec-9e0b-f377854ff059 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.888715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf049b-fd5a-41ec-9e0b-f377854ff059 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.889398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf049b-fd5a-41ec-9e0b-f377854ff059 None admin] RBAC: Adding query filter params (name=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:51.889701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf049b-fd5a-41ec-9e0b-f377854ff059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:51.891167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf049b-fd5a-41ec-9e0b-f377854ff059 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:51.901236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 519/1038] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:51.902381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:51.954330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e9994-2192-4bc0-b927-cbd6be149037 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.954571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e9994-2192-4bc0-b927-cbd6be149037 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.954852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e9994-2192-4bc0-b927-cbd6be149037 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.956420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 520/1039] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:51.961234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81a88d-288c-4e48-b415-637f573c6243 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:51.961482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81a88d-288c-4e48-b415-637f573c6243 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:51.961797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81a88d-288c-4e48-b415-637f573c6243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:51.980622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ea81a88d-288c-4e48-b415-637f573c6243 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:51.981830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ea81a88d-288c-4e48-b415-637f573c6243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:52.005094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:52.011263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3a080-5f45-4455-b8cb-0fca306ed08f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:52.038009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:52.048243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:52.049115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:52.049580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:52.050052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:52.050899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:52.051406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:52.052955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:52.053142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 521/1040] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:52.058766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 520/1041] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:52.064447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81a88d-288c-4e48-b415-637f573c6243 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:52.077530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:52.177261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81a88d-288c-4e48-b415-637f573c6243 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:52.185867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587142ab-c125-400d-8ce1-dfdcfeb0c9b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:52.211900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:52.212775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:52.213053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:52.213321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:52.214113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] RBAC: Adding query filter params (interface=public, service_id=eac535f1ea114aec9f4f6f7fccdeb76a, region_id=RegionOne) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:52.214423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:52.215811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:52.221014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 522/1042] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:08:52 2022] GET /identity/v3/endpoints?service_id=eac535f1ea114aec9f4f6f7fccdeb76a&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:52.226527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:52.226797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:52.227459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:52.227744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:52.228021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:52.229184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:52.230672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:52.232561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 521/1043] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:52.238038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:52.256153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:52.300577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:52.337704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb04830-9daf-40c6-a0fe-cfaaacbaf3b3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:52.346365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8c0ac-fbd9-4cd8-96d1-8bcb794ba082 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:52.372427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de5eaa-58ab-4814-b825-4151cff3bbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:52.373045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5eaa-58ab-4814-b825-4151cff3bbb9 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:52.373321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5eaa-58ab-4814-b825-4151cff3bbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:52.373627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de5eaa-58ab-4814-b825-4151cff3bbb9 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:52.374279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de5eaa-58ab-4814-b825-4151cff3bbb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:52.375656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de5eaa-58ab-4814-b825-4151cff3bbb9 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:52.382053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6845-1c15-4d01-8fa0-0d0e8c192418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:52.382822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6845-1c15-4d01-8fa0-0d0e8c192418 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:52.383102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6845-1c15-4d01-8fa0-0d0e8c192418 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:52.383503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6845-1c15-4d01-8fa0-0d0e8c192418 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:52.384187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6845-1c15-4d01-8fa0-0d0e8c192418 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:52.385674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6845-1c15-4d01-8fa0-0d0e8c192418 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:52.394323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 523/1044] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:08:52 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:08:52.421969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 522/1045] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:08:52 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:08:53.388656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f8b6-319c-495b-a23d-6cd8b4be2807 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:53.389208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f8b6-319c-495b-a23d-6cd8b4be2807 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:53.389208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787f8b6-319c-495b-a23d-6cd8b4be2807 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:53.390737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 524/1046] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:53.395893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc707-504b-4389-9244-f5b218a5f02e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:53.396326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc707-504b-4389-9244-f5b218a5f02e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:53.396477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdc707-504b-4389-9244-f5b218a5f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:53.415988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-77fdc707-504b-4389-9244-f5b218a5f02e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:53.417181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77fdc707-504b-4389-9244-f5b218a5f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:53.485381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 523/1047] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:53.508247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f8b6-319c-495b-a23d-6cd8b4be2807 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:53.602615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:53.620013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787f8b6-319c-495b-a23d-6cd8b4be2807 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:53.655131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:53.655706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:53.655989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:53.656261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:53.666899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:53.671817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:53.672885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:53.673766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 525/1048] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 01:08:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:53.679176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc707-504b-4389-9244-f5b218a5f02e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:53.726689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:53.782180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdc707-504b-4389-9244-f5b218a5f02e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:53.816143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:53.816770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:53.817063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:53.817335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:53.818073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:53.818381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:53.819817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:53.828277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 524/1049] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 01:08:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:53.834367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:53.939159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e191dab-1b1e-4315-b1ec-0de8ae5daaf1 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:53.973334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:53.974010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:53.974292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:53.974559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:53.984824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:53.986670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:53.993481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:54.003028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:54.003931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:54.004833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:54.004833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:54.004833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:54.004833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:54.005610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 526/1050] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:54.010210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.114174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c0ba6-14bf-4ed8-95b7-eb73878fa60e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.121110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:54.150337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.150968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.151244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.151514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.152205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:54.152505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:54.153889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:54.166641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 525/1051] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:54.172271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.272413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88fb6b-fb69-4d2f-b9a2-282f331d7813 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.306617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea61abf-a715-4a22-9458-01ab93f18f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.307265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea61abf-a715-4a22-9458-01ab93f18f8a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.307539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea61abf-a715-4a22-9458-01ab93f18f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.307808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea61abf-a715-4a22-9458-01ab93f18f8a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.315549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea61abf-a715-4a22-9458-01ab93f18f8a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:54.317011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea61abf-a715-4a22-9458-01ab93f18f8a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-5ea61abf-a715-4a22-9458-01ab93f18f8a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:54.328283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:54.329249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:54.330249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:54.334387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 527/1052] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:54.335268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.385200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe16d-3266-4708-80bc-8137b4b710b9 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.385480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe16d-3266-4708-80bc-8137b4b710b9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.385748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe16d-3266-4708-80bc-8137b4b710b9 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.387154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 528/1053] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:54.392195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e269ec-fc5b-4366-b50b-cb9188ae947c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.392799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e269ec-fc5b-4366-b50b-cb9188ae947c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.392799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e269ec-fc5b-4366-b50b-cb9188ae947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.411678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d2e269ec-fc5b-4366-b50b-cb9188ae947c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:54.412864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d2e269ec-fc5b-4366-b50b-cb9188ae947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:54.441038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365e7b3-6271-4f49-8065-c50a5314c4f2 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.470234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:54.479227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.479862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.480143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.480443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.481239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:54.481549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:54.483039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:54.484543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 529/1054] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:54.485841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec997e6c-580f-4db2-a713-329a8531290a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.486151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec997e6c-580f-4db2-a713-329a8531290a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.486424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec997e6c-580f-4db2-a713-329a8531290a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.487668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 530/1055] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:54.492821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0def3-1ff1-44c7-8e5f-fefe9565bf3d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.493146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0def3-1ff1-44c7-8e5f-fefe9565bf3d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.493467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0def3-1ff1-44c7-8e5f-fefe9565bf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.506547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 526/1056] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:54.507357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.512954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-87e0def3-1ff1-44c7-8e5f-fefe9565bf3d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:54.514164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-87e0def3-1ff1-44c7-8e5f-fefe9565bf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:54.532724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:54.579878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 531/1057] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:54.580731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0def3-1ff1-44c7-8e5f-fefe9565bf3d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.607988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e1a5b-2dfc-49ec-80a7-0083f87f4e4c None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.644141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.644806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.645087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.645357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.646178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:54.647457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:54.657145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:54.658395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:54.659262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 527/1058] 10.222.0.17 () {56 vars in 1105 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:54.660186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.683762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0def3-1ff1-44c7-8e5f-fefe9565bf3d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.701145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:54.719552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.720195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.720470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.720734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.730598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:54.732060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:54.746441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:54.746572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:54.747417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:54.748301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:54.748301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:54.748301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:54.748301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:54.748301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 532/1059] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:54.748577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.761024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ffce1-0d20-41d3-87fb-feb150e376c0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.795056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.795635 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.795918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.796194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.807168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:54.812560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:54.813708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 528/1060] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:54.814698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.853675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f568c-dd2b-4f2f-8cad-c396c52a6b1a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.885921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.886562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.886840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.887109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.887784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] RBAC: Adding query filter params (name=image) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:54.888088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:54.889447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:54.894425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 533/1061] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:54.895230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.917409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a48b62-da81-4259-bbe5-613e7b0fc458 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:54.933562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:54.953302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:54.953959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:54.954260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:54.954532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:54.955227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:54.955530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:54.957190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:54.971254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 529/1062] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:54.972094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:54.986364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:55.016874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae24f48-09a6-4735-b4f8-9f67c4bb8230 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.051333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.051896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.052174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.052451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.053163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:55.053470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.054892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.063479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 534/1063] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:55.064383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:55.075974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d632d-77f4-467d-ab60-91e39c55a12e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.109727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.110416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.110687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.110957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.111623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] RBAC: Adding query filter params (type=image) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:55.111921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.113324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.118189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 530/1064] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:55.119060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:55.163735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:55.169726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1a076-0ddd-4be6-b036-97d608ab8b1b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.189374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:55.203902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.204558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.204837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.205112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.211698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.213187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.218198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ade68c-bd0a-4ea8-81b8-b6022fb1eb71 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:55.224301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:55.225285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 535/1065] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:55.226250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:55.254140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.254784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.255065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.255330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] PATH_INFO: `/v3/users/4c5914141c944d1985a8a7840a1fea16` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.269384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] RBAC: Authorizing `identity:get_user(user_id=4c5914141c944d1985a8a7840a1fea16)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.271007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.272673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 531/1066] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:08:55 2022] GET /identity/v3/users/4c5914141c944d1985a8a7840a1fea16 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:55.273430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:55.324547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bf356-19bd-4507-a08c-d09059e26a3a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.356259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.356875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.357149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.357422 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.358151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.359506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.376974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af82657-883b-4d66-b736-a2875990f796 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.379550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 536/1067] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:08:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:08:55.380343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:55.398252 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:55.415848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:55.432624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.433302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.433580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.433855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.435040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:55.435349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.436868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.449837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 532/1068] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:55.456403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:55.516225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0a06a-7a72-4626-8e87-dcaa901751bc None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.555136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.555773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.556054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.556338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.575960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755fb51b-9de9-4f72-9ed8-0d231721528f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.612305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.612987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.613265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.613536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/2d0553dc133749eab4777d6552a93178/roles/1c300f06fd914d06a9eee875ee14493c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.615917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=2d0553dc133749eab4777d6552a93178, role_id=1c300f06fd914d06a9eee875ee14493c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.617603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.630055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.631597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.638000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 533/1069] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:55 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/2d0553dc133749eab4777d6552a93178/roles/1c300f06fd914d06a9eee875ee14493c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:08:55.652496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:55.748181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 537/1070] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:55.754542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:55.806182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:55.862500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592a98-8387-47b6-a1c0-92ab6b1d74cf None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:55.897279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71940f-dfe0-4d55-92e6-069ec76ee358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:55.897947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71940f-dfe0-4d55-92e6-069ec76ee358 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:55.898248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71940f-dfe0-4d55-92e6-069ec76ee358 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:55.898522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71940f-dfe0-4d55-92e6-069ec76ee358 None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:55.899701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71940f-dfe0-4d55-92e6-069ec76ee358 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e912bea51b4ec3a9f2a5f6704010f8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:55.901168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71940f-dfe0-4d55-92e6-069ec76ee358 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:55.903061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 534/1071] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:08:55 2022] GET /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:55.909541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:56.013143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb45344-48d0-46c5-8f19-9c702b5815c0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:56.026855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:56.049750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e8e9-3a18-488f-b124-0baa65b30a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:56.050558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e8e9-3a18-488f-b124-0baa65b30a8c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:56.050932 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e8e9-3a18-488f-b124-0baa65b30a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:56.051303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e8e9-3a18-488f-b124-0baa65b30a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:56.052210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e8e9-3a18-488f-b124-0baa65b30a8c None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8, user.id=4c5914141c944d1985a8a7840a1fea16) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:56.052619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e8e9-3a18-488f-b124-0baa65b30a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:56.054185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e8e9-3a18-488f-b124-0baa65b30a8c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:56.060155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 538/1072] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:55 2022] GET /identity/v3/role_assignments?user.id=4c5914141c944d1985a8a7840a1fea16&scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:57.395662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0057e-4a87-42f4-a4eb-92db88cfbbba None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:57.396241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0057e-4a87-42f4-a4eb-92db88cfbbba None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:57.396241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0057e-4a87-42f4-a4eb-92db88cfbbba None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:57.397796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 535/1073] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:57.402832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a037c0-876a-4d83-b006-e2f51ced4550 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:57.403261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a037c0-876a-4d83-b006-e2f51ced4550 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:57.403340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a037c0-876a-4d83-b006-e2f51ced4550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:57.422449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-92a037c0-876a-4d83-b006-e2f51ced4550 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:57.423703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-92a037c0-876a-4d83-b006-e2f51ced4550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:57.497975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 539/1074] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:57.522620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0057e-4a87-42f4-a4eb-92db88cfbbba None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:57.602053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec220de0-b2cd-4dc3-84d0-3527153279e4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:57.602391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec220de0-b2cd-4dc3-84d0-3527153279e4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:57.602558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec220de0-b2cd-4dc3-84d0-3527153279e4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:57.604064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 540/1075] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:08:57.608906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af848c3-b215-493c-ae84-5f68ea57650a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:57.609191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af848c3-b215-493c-ae84-5f68ea57650a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:57.609452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af848c3-b215-493c-ae84-5f68ea57650a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:57.627452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2af848c3-b215-493c-ae84-5f68ea57650a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:57.627835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0057e-4a87-42f4-a4eb-92db88cfbbba None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:57.628599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2af848c3-b215-493c-ae84-5f68ea57650a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:57.643266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:57.663650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:57.664200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:57.664478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:57.664749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:57.699608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 541/1076] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:08:57.722763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af848c3-b215-493c-ae84-5f68ea57650a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:57.736083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:57.737732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:57.757889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:57.824272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af848c3-b215-493c-ae84-5f68ea57650a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:57.840110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 536/1077] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:08:57.845990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:57.860502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:57.861069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:57.861532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:57.861828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:57.862096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:57.873146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:57.878177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:57.879121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:57.880204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 542/1078] 10.222.0.17 () {56 vars in 1120 bytes} [Sat Aug 6 01:08:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:57.885329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:57.957663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad7f63-98b6-4d27-8df9-d69f8d9db55d None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:57.988873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:57.994258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9970a66-179e-4e96-87b4-f2d901484835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:57.995135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970a66-179e-4e96-87b4-f2d901484835 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:57.995589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970a66-179e-4e96-87b4-f2d901484835 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:57.995814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b81d47-e682-4959-b333-9de18c9935bd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:57.996180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9970a66-179e-4e96-87b4-f2d901484835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.007751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9970a66-179e-4e96-87b4-f2d901484835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.009248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9970a66-179e-4e96-87b4-f2d901484835 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a9970a66-179e-4e96-87b4-f2d901484835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:58.024453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:58.025552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:58.026759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:58.026759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:58.026759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:58.026759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:58.026759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 537/1079] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:58.027102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7768f3c-d48e-4474-81b2-a3d12aa3fc01 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.027102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7768f3c-d48e-4474-81b2-a3d12aa3fc01 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.027370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7768f3c-d48e-4474-81b2-a3d12aa3fc01 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.030091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 538/1080] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:08:58.032162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7768f3c-d48e-4474-81b2-a3d12aa3fc01 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.036313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e249fa7-ea5d-448f-a6fc-de2f18fde8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.036969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249fa7-ea5d-448f-a6fc-de2f18fde8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.037238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249fa7-ea5d-448f-a6fc-de2f18fde8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.037503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e249fa7-ea5d-448f-a6fc-de2f18fde8a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.038251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e249fa7-ea5d-448f-a6fc-de2f18fde8a0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:58.038555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e249fa7-ea5d-448f-a6fc-de2f18fde8a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.039924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e249fa7-ea5d-448f-a6fc-de2f18fde8a0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.048065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 543/1081] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 01:08:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:58.049281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474820-a521-4ccf-b149-8b8f436dcbbd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.049563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474820-a521-4ccf-b149-8b8f436dcbbd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.049831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e474820-a521-4ccf-b149-8b8f436dcbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.067137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9e474820-a521-4ccf-b149-8b8f436dcbbd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:08:58.068372 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9e474820-a521-4ccf-b149-8b8f436dcbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:08:58.099722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.135162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7768f3c-d48e-4474-81b2-a3d12aa3fc01 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.135474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 544/1082] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:08:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:08:58.136302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474820-a521-4ccf-b149-8b8f436dcbbd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.169896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.170566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.170916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.171131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.171775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:58.172082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.173736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.189978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 539/1083] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:58.189978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.249837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.264910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e474820-a521-4ccf-b149-8b8f436dcbbd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.297822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48626325-8fcb-485d-aee5-94772f43b7e5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.305972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.306663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.306940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.307213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.320238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.321979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.328857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.339456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.340091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.340392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.340665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:58.341026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:58.342238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:58.343397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:58.343397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:58.343397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:58.343397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:58.343397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 545/1084] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:58.351235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.357249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:08:58.362898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:58.363877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:58.364740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 540/1085] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:58.370749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.471023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a781ff6-0211-4292-9a6a-00a8a5d411ca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.491460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3065fa-d2ae-404e-bec8-6e423572d504 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.506527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.507163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.507441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.507717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.508439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:58.508747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.510147 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.519080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.525786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.526438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.526716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.526990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.527318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 546/1086] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:58.527891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:58.528170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.528280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.529958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.538417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 541/1087] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:58.544099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.590771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.625236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97df9bb-c184-44f6-8600-65a8905642df None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.642220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec6fa-7d76-44b1-9284-76d48f8ea7cb None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.661963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.662632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.662906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.663185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.670494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.671925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.676749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.677397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.677678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.677963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] PATH_INFO: `/v3/users/4c5914141c944d1985a8a7840a1fea16` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.679228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] RBAC: Authorizing `identity:get_user(user_id=4c5914141c944d1985a8a7840a1fea16)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.680689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.682429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 542/1088] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/users/4c5914141c944d1985a8a7840a1fea16 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:08:58.683371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:58.684439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:08:58.685387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 547/1089] 10.222.0.17 () {56 vars in 1093 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:58.688343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.690129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.747140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.786956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6edd98-cba3-452d-a4c0-1aaf8aff82b7 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.788233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b4850-6433-46fe-8999-3efd23ecd44a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.802550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.820083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.820698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.820816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.820987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.821259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.821368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.821589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.821870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.822434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e912bea51b4ec3a9f2a5f6704010f8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.822720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:58.823030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.823887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.824459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.825556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 543/1090] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:58.831540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.842968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 548/1091] 10.222.0.17 () {56 vars in 1133 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:08:58.848660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:58.933596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f62d-56b1-409f-a689-a9db773cc6c4 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.944383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666c248-501b-45b0-98d9-d9bfc523a02a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:58.961817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:58.969862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.970573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.970857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.971122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8/users/4c5914141c944d1985a8a7840a1fea16/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.973147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e912bea51b4ec3a9f2a5f6704010f8, user_id=4c5914141c944d1985a8a7840a1fea16, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:58.974641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:58.979798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:58.980491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:58.980807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:58.981119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:58.988888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 544/1092] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:08:58 2022] PUT /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8/users/4c5914141c944d1985a8a7840a1fea16/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:08:59.058137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:59.059595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:59.168618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 549/1093] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:08:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 06 01:08:59.175043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:59.223579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:59.277801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef7e2-28a9-4d42-ba28-ef5b21de458b None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:59.311267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:59.311840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:59.312115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:59.312385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:59.322934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:59.324411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:08:59.338399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:59.339346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:59.340239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:08:59.340239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:08:59.340239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:08:59.340239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:59.340239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 545/1094] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:08:59.345673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:59.364594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:59.446313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a449b6-0197-4860-aebd-9448e98f993d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:59.480655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:59.481310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:59.481537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:59.481804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:59.482530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:59.482835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:59.484212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:59.498597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 550/1095] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:59.504445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:59.598035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:59.604462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ade9f7-94d7-458f-90c1-1f00d8d20fd1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:59.640947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:59.641622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:59.641897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:59.642200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:59.649133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:59.650621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:08:59.662558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:08:59.663495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:08:59.664398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 546/1096] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:08:59.669860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:59.751217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:08:59.773091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8da620-16aa-469f-acdd-14fb322a85f0 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:59.808439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0dbe0-e504-49a0-b816-597decc68e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:59.809077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0dbe0-e504-49a0-b816-597decc68e01 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:59.809352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0dbe0-e504-49a0-b816-597decc68e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:59.809612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0dbe0-e504-49a0-b816-597decc68e01 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:59.810458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0dbe0-e504-49a0-b816-597decc68e01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:59.810768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0dbe0-e504-49a0-b816-597decc68e01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:59.812198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0dbe0-e504-49a0-b816-597decc68e01 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:59.823819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 551/1097] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:08:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:08:59.831429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:08:59.935379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c56be-bcdb-47a1-b8a3-239bcb1a27b0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:08:59.976401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ff1dd-b8af-43e9-9e79-1a16b3bfdf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:08:59.977016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff1dd-b8af-43e9-9e79-1a16b3bfdf96 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:08:59.977290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff1dd-b8af-43e9-9e79-1a16b3bfdf96 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:08:59.977564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ff1dd-b8af-43e9-9e79-1a16b3bfdf96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:08:59.978394 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff1dd-b8af-43e9-9e79-1a16b3bfdf96 None admin] RBAC: Adding query filter params (role.id=1c300f06fd914d06a9eee875ee14493c, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=2d0553dc133749eab4777d6552a93178) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:08:59.978704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff1dd-b8af-43e9-9e79-1a16b3bfdf96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:08:59.980148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ff1dd-b8af-43e9-9e79-1a16b3bfdf96 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:08:59.986848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 547/1098] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:08:59 2022] GET /identity/v3/role_assignments?user.id=2d0553dc133749eab4777d6552a93178&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1c300f06fd914d06a9eee875ee14493c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:00.968943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adc4c4-1076-4a2e-867f-0fb624ee2e35 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:00.969614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adc4c4-1076-4a2e-867f-0fb624ee2e35 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:00.969697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adc4c4-1076-4a2e-867f-0fb624ee2e35 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:00.971196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 552/1099] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:00.976556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a438-88fb-43b4-9bec-94b99cdcd4d0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:00.976976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a438-88fb-43b4-9bec-94b99cdcd4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:00.977108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0a438-88fb-43b4-9bec-94b99cdcd4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:00.996359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1bc0a438-88fb-43b4-9bec-94b99cdcd4d0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:00.997604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1bc0a438-88fb-43b4-9bec-94b99cdcd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:01.013004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:01.070197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 548/1100] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:01.103602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adc4c4-1076-4a2e-867f-0fb624ee2e35 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:01.212402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adc4c4-1076-4a2e-867f-0fb624ee2e35 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:01.248580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:01.249149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:01.249427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:01.249697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:01.257764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:01.262516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:09:01.267930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:01.268945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:09:01.269809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 553/1101] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:09:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:01.277978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a438-88fb-43b4-9bec-94b99cdcd4d0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:01.383199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0a438-88fb-43b4-9bec-94b99cdcd4d0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:01.419238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:01.419850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:01.420128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:01.420401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:01.421128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:01.421432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:01.422914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:01.431038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 549/1102] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:09:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:01.436861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:01.541735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0275435-9065-463a-b3f4-2e58986dea74 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:01.577406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:01.578078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:01.578353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:01.578656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] PATH_INFO: `/v3/users/4c5914141c944d1985a8a7840a1fea16` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:01.579940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] RBAC: Authorizing `identity:get_user(user_id=4c5914141c944d1985a8a7840a1fea16)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:01.581386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:01.583030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 554/1103] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:01 2022] GET /identity/v3/users/4c5914141c944d1985a8a7840a1fea16 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:01.592352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:01.609045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:01.695653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d8801-d32e-4984-85c9-f90c53249a2f None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:01.736504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:01.737110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:01.737390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:01.737638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:01.808901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:01.810325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:01.823623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:01.922936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 550/1104] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:01.932389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:02.015419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:02.054373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9487f0-cda7-4017-a8ab-f012a184f7fd None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:02.090500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a7e2b-aba7-4f63-a7b1-f78bf64b4837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:02.091073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7e2b-aba7-4f63-a7b1-f78bf64b4837 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:02.091347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7e2b-aba7-4f63-a7b1-f78bf64b4837 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:02.091616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7e2b-aba7-4f63-a7b1-f78bf64b4837 None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:02.092802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a7e2b-aba7-4f63-a7b1-f78bf64b4837 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e912bea51b4ec3a9f2a5f6704010f8)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:02.094307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a7e2b-aba7-4f63-a7b1-f78bf64b4837 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:02.096003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 555/1105] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:01 2022] GET /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:02.102500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:02.206452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4496fc-f9f4-4f3f-aed2-cb5b024ab3ad None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:02.221132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:02.244931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da924a2b-485b-4cad-b6c2-e582150ad08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:02.245538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924a2b-485b-4cad-b6c2-e582150ad08d None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:02.245815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924a2b-485b-4cad-b6c2-e582150ad08d None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:02.246114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da924a2b-485b-4cad-b6c2-e582150ad08d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:02.246909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924a2b-485b-4cad-b6c2-e582150ad08d None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8, user.id=4c5914141c944d1985a8a7840a1fea16) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:02.247216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924a2b-485b-4cad-b6c2-e582150ad08d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:02.248677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da924a2b-485b-4cad-b6c2-e582150ad08d None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:02.254622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 551/1106] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:09:02 2022] GET /identity/v3/role_assignments?user.id=4c5914141c944d1985a8a7840a1fea16&scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:04.226382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ecda-8b08-4117-801f-e270e06add48 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:04.227240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ecda-8b08-4117-801f-e270e06add48 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:04.227240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ecda-8b08-4117-801f-e270e06add48 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:04.229409 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 556/1107] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:04.237972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399301ac-7d73-4485-a6c8-7869092a37a0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:04.238362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399301ac-7d73-4485-a6c8-7869092a37a0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:04.238554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399301ac-7d73-4485-a6c8-7869092a37a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:04.267731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-399301ac-7d73-4485-a6c8-7869092a37a0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:04.268928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-399301ac-7d73-4485-a6c8-7869092a37a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:04.339141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 552/1108] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:04.363315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ecda-8b08-4117-801f-e270e06add48 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:04.486023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ecda-8b08-4117-801f-e270e06add48 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:04.521535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499aa577-327c-4bd7-a865-d710c2c3ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:04.522220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa577-327c-4bd7-a865-d710c2c3ec28 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:04.522501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa577-327c-4bd7-a865-d710c2c3ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:04.522773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499aa577-327c-4bd7-a865-d710c2c3ec28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:04.524006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aa577-327c-4bd7-a865-d710c2c3ec28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:04.525455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499aa577-327c-4bd7-a865-d710c2c3ec28 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:04.527143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 557/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:09:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:04.533697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399301ac-7d73-4485-a6c8-7869092a37a0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:04.637965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399301ac-7d73-4485-a6c8-7869092a37a0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:04.645213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:04.674271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982c673-e1aa-4e38-a04b-2a3641b75106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:04.674883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c673-e1aa-4e38-a04b-2a3641b75106 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:04.675159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c673-e1aa-4e38-a04b-2a3641b75106 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:04.675492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982c673-e1aa-4e38-a04b-2a3641b75106 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:04.676167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982c673-e1aa-4e38-a04b-2a3641b75106 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:04.677611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982c673-e1aa-4e38-a04b-2a3641b75106 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:04.704597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 553/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:09:04 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:09:06.747327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810895-0919-45bb-b7ad-8c2ee74baa46 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:06.747884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810895-0919-45bb-b7ad-8c2ee74baa46 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:06.747884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810895-0919-45bb-b7ad-8c2ee74baa46 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:06.749249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 558/1111] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:06.755683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718e48-ea32-411d-80f3-de48fa05e1e6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:06.756418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718e48-ea32-411d-80f3-de48fa05e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:06.756418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f718e48-ea32-411d-80f3-de48fa05e1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:06.786204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3f718e48-ea32-411d-80f3-de48fa05e1e6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:06.787403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3f718e48-ea32-411d-80f3-de48fa05e1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:06.866644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 554/1112] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:06.889821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810895-0919-45bb-b7ad-8c2ee74baa46 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:06.893145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:06.999119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810895-0919-45bb-b7ad-8c2ee74baa46 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:07.034389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:07.034951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:07.035224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:07.035491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] PATH_INFO: `/v3/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:07.037043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] RBAC: Authorizing `identity:get_role(role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:07.038450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:07.039801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 559/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:06 2022] GET /identity/v3/roles/063bbdfce3224ede93cacead71ab0bfa => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:07.048536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f718e48-ea32-411d-80f3-de48fa05e1e6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:07.138337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:07.147522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f718e48-ea32-411d-80f3-de48fa05e1e6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:07.182632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:07.183271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:07.183544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:07.183812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] PATH_INFO: `/v3/users/ae0d6b849a4f45c3871063620598d487` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:07.197615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0d6b849a4f45c3871063620598d487)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:07.199101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:07.200716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 555/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:07 2022] GET /identity/v3/users/ae0d6b849a4f45c3871063620598d487 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:09:07.207255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:07.286028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:07.323003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdea39f-12e1-4665-b53d-e0f9035a8677 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:07.369597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:07.370231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:07.370510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:07.370780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:07.441942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:07.443423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:07.532103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:07.566741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 560/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:07.572892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:07.675889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1004e1-2b81-46f5-bb8a-1be5d74bdc19 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:07.711494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27d17f-540c-4f0e-b1b9-bd45dc9f5df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:07.712109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d17f-540c-4f0e-b1b9-bd45dc9f5df8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:07.712380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d17f-540c-4f0e-b1b9-bd45dc9f5df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:07.712650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27d17f-540c-4f0e-b1b9-bd45dc9f5df8 None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:07.713923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27d17f-540c-4f0e-b1b9-bd45dc9f5df8 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e912bea51b4ec3a9f2a5f6704010f8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:07.715395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27d17f-540c-4f0e-b1b9-bd45dc9f5df8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:07.717047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 556/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:07 2022] GET /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:07.723236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:07.839841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b34d8f-4aeb-4868-8710-c84332e6eccf None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:07.879582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665f5fb-1406-47fb-bbfc-b1a0f4806295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:07.880189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f5fb-1406-47fb-bbfc-b1a0f4806295 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:07.880467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f5fb-1406-47fb-bbfc-b1a0f4806295 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:07.880741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f5fb-1406-47fb-bbfc-b1a0f4806295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:07.881523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f5fb-1406-47fb-bbfc-b1a0f4806295 None admin] RBAC: Adding query filter params (role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8, user.id=ae0d6b849a4f45c3871063620598d487) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:07.881827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f5fb-1406-47fb-bbfc-b1a0f4806295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:07.883291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f5fb-1406-47fb-bbfc-b1a0f4806295 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:07.889250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 561/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:09:07 2022] GET /identity/v3/role_assignments?user.id=ae0d6b849a4f45c3871063620598d487&scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:09.817463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b508c3-82f6-4fe1-9b9d-448ab06f3f43 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:09.818355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b508c3-82f6-4fe1-9b9d-448ab06f3f43 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:09.818355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b508c3-82f6-4fe1-9b9d-448ab06f3f43 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:09.820503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 557/1118] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:09.826874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6ca2-3249-4fd7-9384-644973133d2e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:09.827292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6ca2-3249-4fd7-9384-644973133d2e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:09.827436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb6ca2-3249-4fd7-9384-644973133d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:09.852377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-32bb6ca2-3249-4fd7-9384-644973133d2e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:09.853581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-32bb6ca2-3249-4fd7-9384-644973133d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:09.881667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:09.934475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 562/1119] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:09.957893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b508c3-82f6-4fe1-9b9d-448ab06f3f43 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:09.983348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:10.069803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b508c3-82f6-4fe1-9b9d-448ab06f3f43 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:10.104454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:10.105079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:10.105365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:10.105625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] PATH_INFO: `/v3/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:10.107201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] RBAC: Authorizing `identity:get_role(role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:10.108586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:10.110013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 558/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:09 2022] GET /identity/v3/roles/063bbdfce3224ede93cacead71ab0bfa => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:10.115983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb6ca2-3249-4fd7-9384-644973133d2e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:10.229332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb6ca2-3249-4fd7-9384-644973133d2e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:10.271670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:10.272316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:10.272590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:10.272860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] PATH_INFO: `/v3/users/ae0d6b849a4f45c3871063620598d487` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:10.274230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] RBAC: Authorizing `identity:get_user(user_id=ae0d6b849a4f45c3871063620598d487)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:10.275664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:10.277276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 563/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:10 2022] GET /identity/v3/users/ae0d6b849a4f45c3871063620598d487 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:10.284333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:10.375293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:10.391917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d688e7-052d-47e2-b79d-ff5f4ac1e129 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:10.432974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ce24b-858f-49a8-b0fc-5553feb34016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:10.433606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ce24b-858f-49a8-b0fc-5553feb34016 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:10.433881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ce24b-858f-49a8-b0fc-5553feb34016 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:10.434171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ce24b-858f-49a8-b0fc-5553feb34016 None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:10.435451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ce24b-858f-49a8-b0fc-5553feb34016 None admin] RBAC: Authorizing `identity:get_project(project_id=b8e912bea51b4ec3a9f2a5f6704010f8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:10.436893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ce24b-858f-49a8-b0fc-5553feb34016 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:10.438623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 559/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:10 2022] GET /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:10.445092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:10.480026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:10.554200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f482632c-ff42-488e-a1aa-6f280e9f06aa None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:10.591238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb83c-be1b-4a08-88d2-93269b85d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:10.591914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb83c-be1b-4a08-88d2-93269b85d59b None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:10.592189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb83c-be1b-4a08-88d2-93269b85d59b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:10.592464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb83c-be1b-4a08-88d2-93269b85d59b None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8/users/ae0d6b849a4f45c3871063620598d487/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:10.595080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fb83c-be1b-4a08-88d2-93269b85d59b None admin] RBAC: Authorizing `identity:create_grant(project_id=b8e912bea51b4ec3a9f2a5f6704010f8, user_id=ae0d6b849a4f45c3871063620598d487, role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:10.596529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fb83c-be1b-4a08-88d2-93269b85d59b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:10.612923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 564/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:09:10 2022] PUT /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8/users/ae0d6b849a4f45c3871063620598d487/roles/063bbdfce3224ede93cacead71ab0bfa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:09:12.545855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c503-d51f-477a-82b8-7e24546e8b3a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:12.546367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c503-d51f-477a-82b8-7e24546e8b3a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:12.546463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57c503-d51f-477a-82b8-7e24546e8b3a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:12.547951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 560/1124] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:12.554284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d8cf-57ce-443a-a2e3-51a4c5c9633b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:12.555056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d8cf-57ce-443a-a2e3-51a4c5c9633b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:12.555237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d8cf-57ce-443a-a2e3-51a4c5c9633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:12.582537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ae63d8cf-57ce-443a-a2e3-51a4c5c9633b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:12.583729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ae63d8cf-57ce-443a-a2e3-51a4c5c9633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:12.657054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 565/1125] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:12.686220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c503-d51f-477a-82b8-7e24546e8b3a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:12.810836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57c503-d51f-477a-82b8-7e24546e8b3a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:12.849339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:12.849972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:12.850258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:12.850529 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] PATH_INFO: `/v3/roles/063bbdfce3224ede93cacead71ab0bfa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:12.852093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] RBAC: Authorizing `identity:get_role(role_id=063bbdfce3224ede93cacead71ab0bfa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:12.853446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:12.854868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 561/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:12 2022] GET /identity/v3/roles/063bbdfce3224ede93cacead71ab0bfa => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:12.861367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63d8cf-57ce-443a-a2e3-51a4c5c9633b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:12.890376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:12.970909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63d8cf-57ce-443a-a2e3-51a4c5c9633b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:13.006518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:13.007155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:13.007434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:13.007708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] PATH_INFO: `/v3/users/ae0d6b849a4f45c3871063620598d487` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:13.008999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0d6b849a4f45c3871063620598d487)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:13.010486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:13.012119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 566/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:12 2022] GET /identity/v3/users/ae0d6b849a4f45c3871063620598d487 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:13.018097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:13.043380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:13.118034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069e033-4ea0-4913-accb-f08aa42e9d3a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:13.153323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:13.154317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:13.154593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:13.154864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:13.223479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:13.224984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:13.248962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:13.324802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 562/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:13.331010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:13.424370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:13.435019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac163c4-3740-45e2-8d1f-b8200298ba51 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:13.469340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a19f2-6092-48e1-8edc-0f37b9d49abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:13.469962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a19f2-6092-48e1-8edc-0f37b9d49abe None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:13.470271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a19f2-6092-48e1-8edc-0f37b9d49abe None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:13.470539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a19f2-6092-48e1-8edc-0f37b9d49abe None admin] PATH_INFO: `/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:13.471751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a19f2-6092-48e1-8edc-0f37b9d49abe None admin] RBAC: Authorizing `identity:get_project(project_id=b8e912bea51b4ec3a9f2a5f6704010f8)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:13.473176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a19f2-6092-48e1-8edc-0f37b9d49abe None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:13.474923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 567/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:13 2022] GET /identity/v3/projects/b8e912bea51b4ec3a9f2a5f6704010f8 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:13.481714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:13.592192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e61697-7ae2-464b-8eca-536a2df7f848 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:13.614721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:13.627494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69108d9e-1362-4271-ba9d-416f4ba086d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:13.628106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69108d9e-1362-4271-ba9d-416f4ba086d5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:13.628384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69108d9e-1362-4271-ba9d-416f4ba086d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:13.628655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69108d9e-1362-4271-ba9d-416f4ba086d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:13.629439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69108d9e-1362-4271-ba9d-416f4ba086d5 None admin] RBAC: Adding query filter params (role.id=063bbdfce3224ede93cacead71ab0bfa, scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8, user.id=ae0d6b849a4f45c3871063620598d487) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:13.629747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69108d9e-1362-4271-ba9d-416f4ba086d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:13.631221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69108d9e-1362-4271-ba9d-416f4ba086d5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:13.637107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 563/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:09:13 2022] GET /identity/v3/role_assignments?user.id=ae0d6b849a4f45c3871063620598d487&scope.project.id=b8e912bea51b4ec3a9f2a5f6704010f8&role.id=063bbdfce3224ede93cacead71ab0bfa => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:15.612432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a129c4-063d-4f37-ab84-1f7040225f03 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:15.613014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a129c4-063d-4f37-ab84-1f7040225f03 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:15.613014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a129c4-063d-4f37-ab84-1f7040225f03 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:15.614381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 568/1131] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:15.619908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7875-99e2-4013-ab9f-a173df045851 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:15.620362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7875-99e2-4013-ab9f-a173df045851 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:15.620452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed7875-99e2-4013-ab9f-a173df045851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:15.641364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-38ed7875-99e2-4013-ab9f-a173df045851 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:15.642597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-38ed7875-99e2-4013-ab9f-a173df045851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:15.711964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 564/1132] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:15.743972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a129c4-063d-4f37-ab84-1f7040225f03 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:15.850348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a129c4-063d-4f37-ab84-1f7040225f03 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:15.886816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5d1f3-9e03-4d0f-a042-ea1c11f3d71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:15.887472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d1f3-9e03-4d0f-a042-ea1c11f3d71e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:15.887746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d1f3-9e03-4d0f-a042-ea1c11f3d71e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:15.888013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d1f3-9e03-4d0f-a042-ea1c11f3d71e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:15.889246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5d1f3-9e03-4d0f-a042-ea1c11f3d71e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:15.890784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5d1f3-9e03-4d0f-a042-ea1c11f3d71e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:15.892421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 569/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:09:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:15.900934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7875-99e2-4013-ab9f-a173df045851 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:16.008684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed7875-99e2-4013-ab9f-a173df045851 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:16.026610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:16.048178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac483f4a-5029-4478-b413-bf310eb860ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:16.048811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483f4a-5029-4478-b413-bf310eb860ce None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:16.049091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483f4a-5029-4478-b413-bf310eb860ce None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:16.049364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483f4a-5029-4478-b413-bf310eb860ce None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:16.050083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac483f4a-5029-4478-b413-bf310eb860ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:16.051549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac483f4a-5029-4478-b413-bf310eb860ce None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:16.085158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 565/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:09:15 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:09:18.083126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93319-91d3-4acb-86a6-e2d3d97afb5d None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:18.083977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93319-91d3-4acb-86a6-e2d3d97afb5d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:18.084565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93319-91d3-4acb-86a6-e2d3d97afb5d None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:18.086811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 570/1135] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:18.092092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cb50-0684-4dbe-9a37-e40b69579635 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:18.092519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cb50-0684-4dbe-9a37-e40b69579635 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:18.092617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270cb50-0684-4dbe-9a37-e40b69579635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:18.112491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c270cb50-0684-4dbe-9a37-e40b69579635 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:18.113674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c270cb50-0684-4dbe-9a37-e40b69579635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:18.192397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 566/1136] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:18.227382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93319-91d3-4acb-86a6-e2d3d97afb5d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:18.254996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:18.333656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93319-91d3-4acb-86a6-e2d3d97afb5d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:18.369093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8a4fb-d4d1-4862-9f2e-4db3627d3ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:18.369722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a4fb-d4d1-4862-9f2e-4db3627d3ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:18.369991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a4fb-d4d1-4862-9f2e-4db3627d3ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:18.370303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8a4fb-d4d1-4862-9f2e-4db3627d3ef3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:18.371572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8a4fb-d4d1-4862-9f2e-4db3627d3ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:18.373012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8a4fb-d4d1-4862-9f2e-4db3627d3ef3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:18.374649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 571/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:09:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:09:18.380782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270cb50-0684-4dbe-9a37-e40b69579635 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:18.481160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:18.485368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270cb50-0684-4dbe-9a37-e40b69579635 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:18.520427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b55616-265e-4455-8abd-0bec3c430a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:18.521050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55616-265e-4455-8abd-0bec3c430a72 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:18.521328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55616-265e-4455-8abd-0bec3c430a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:18.521602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b55616-265e-4455-8abd-0bec3c430a72 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:18.522331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b55616-265e-4455-8abd-0bec3c430a72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:18.523789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b55616-265e-4455-8abd-0bec3c430a72 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:18.548474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 567/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:09:18 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:09:20.580621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d011-9a2a-430d-a63b-581b154fe887 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:20.581150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d011-9a2a-430d-a63b-581b154fe887 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:20.581150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4d011-9a2a-430d-a63b-581b154fe887 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:20.582580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 572/1139] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:20.588838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cf6ab-14a6-4604-a9de-8907882a64e7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:20.589544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cf6ab-14a6-4604-a9de-8907882a64e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:20.589717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cf6ab-14a6-4604-a9de-8907882a64e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:20.611076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-277cf6ab-14a6-4604-a9de-8907882a64e7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:20.612261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-277cf6ab-14a6-4604-a9de-8907882a64e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:20.695552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 568/1140] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:20.718777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d011-9a2a-430d-a63b-581b154fe887 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:20.818754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:20.827361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4d011-9a2a-430d-a63b-581b154fe887 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:20.865373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:20.866033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:20.866312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:20.866580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:20.877601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:09:20.882489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:20.883589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:09:20.884944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 573/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:20.891289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cf6ab-14a6-4604-a9de-8907882a64e7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:20.975683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:20.999519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cf6ab-14a6-4604-a9de-8907882a64e7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:21.033349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:21.033971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:21.034279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:21.034549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:21.035269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:21.035573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:21.036974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:21.044816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 569/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:21.050834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:21.154199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de20ad6-71a7-437f-a126-1f0cc9169515 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:21.189116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:21.189744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:21.190051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:21.190324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] PATH_INFO: `/v3/users/d5fa204a34d84f84916e90d2f835e3e4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:21.204859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] RBAC: Authorizing `identity:get_user(user_id=d5fa204a34d84f84916e90d2f835e3e4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:21.206326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:21.207941 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 574/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:21 2022] GET /identity/v3/users/d5fa204a34d84f84916e90d2f835e3e4 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:21.214659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:21.316573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca378e-75d8-4586-8209-ee9723986e76 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:21.351449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:21.352055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:21.352339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:21.352606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:21.368110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:21.434513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:21.435988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:21.541257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 570/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:21.547728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:21.562990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:21.651281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaf8e6-ba09-4a9b-9c51-c124c27a7667 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:21.698236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001861e6-1e92-461c-9815-dc5aee427fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:21.699163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001861e6-1e92-461c-9815-dc5aee427fcd None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:21.699498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001861e6-1e92-461c-9815-dc5aee427fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:21.699899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001861e6-1e92-461c-9815-dc5aee427fcd None admin] PATH_INFO: `/v3/projects/cd73b02736584fbbb1e122093a7f6549` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:21.702309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001861e6-1e92-461c-9815-dc5aee427fcd None admin] RBAC: Authorizing `identity:get_project(project_id=cd73b02736584fbbb1e122093a7f6549)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:21.704019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001861e6-1e92-461c-9815-dc5aee427fcd None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:21.705671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 575/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:21 2022] GET /identity/v3/projects/cd73b02736584fbbb1e122093a7f6549 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:21.712583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:21.764067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:21.821321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed09ed8-e48d-48bb-a852-bca816d3e249 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:21.862182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a414a7bf-a023-4c52-aa84-61df9b1c55bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:21.863128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a7bf-a023-4c52-aa84-61df9b1c55bf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:21.863565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a7bf-a023-4c52-aa84-61df9b1c55bf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:21.863983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a414a7bf-a023-4c52-aa84-61df9b1c55bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:21.865252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a7bf-a023-4c52-aa84-61df9b1c55bf None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=cd73b02736584fbbb1e122093a7f6549, user.id=d5fa204a34d84f84916e90d2f835e3e4) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:21.865731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a7bf-a023-4c52-aa84-61df9b1c55bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:21.868073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a414a7bf-a023-4c52-aa84-61df9b1c55bf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:21.876396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 571/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:09:21 2022] GET /identity/v3/role_assignments?user.id=d5fa204a34d84f84916e90d2f835e3e4&scope.project.id=cd73b02736584fbbb1e122093a7f6549&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:23.800204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5ffc-ccd8-4734-b84d-e51c731fd30b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:23.801019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5ffc-ccd8-4734-b84d-e51c731fd30b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:23.801019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f5ffc-ccd8-4734-b84d-e51c731fd30b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:23.803230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 576/1147] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:23.808627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89acb-3ec0-41cf-91f6-da1e916e6b3a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:23.809070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89acb-3ec0-41cf-91f6-da1e916e6b3a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:23.809172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89acb-3ec0-41cf-91f6-da1e916e6b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:23.829257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e1e89acb-3ec0-41cf-91f6-da1e916e6b3a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:23.830450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e1e89acb-3ec0-41cf-91f6-da1e916e6b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:23.900271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 572/1148] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:23.930910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f5ffc-ccd8-4734-b84d-e51c731fd30b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:24.012756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:24.033832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f5ffc-ccd8-4734-b84d-e51c731fd30b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:24.069259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:24.069827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:24.070140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:24.070411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:24.081414 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:09:24.086321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:24.087385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:09:24.088509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 577/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:24.093916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e89acb-3ec0-41cf-91f6-da1e916e6b3a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:24.138496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:24.197846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e89acb-3ec0-41cf-91f6-da1e916e6b3a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:24.232014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:24.232628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:24.232898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:24.233169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:24.233898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:24.234235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:24.235617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:24.243648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 573/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:09:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:24.249894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:24.356944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a646be4-8dea-49d2-be10-db6c26b60436 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:24.391575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:24.392197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:24.392467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:24.392735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] PATH_INFO: `/v3/users/d5fa204a34d84f84916e90d2f835e3e4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:24.393974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] RBAC: Authorizing `identity:get_user(user_id=d5fa204a34d84f84916e90d2f835e3e4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:24.395400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:24.396972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 578/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:24 2022] GET /identity/v3/users/d5fa204a34d84f84916e90d2f835e3e4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:24.402638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:24.507294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73415-c3bf-41c8-b445-7ce9ed7fd9ba None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:24.509071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:24.545046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeff9ae-f0e7-432e-9d6e-26dae4ee7c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:24.545690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff9ae-f0e7-432e-9d6e-26dae4ee7c51 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:24.545978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff9ae-f0e7-432e-9d6e-26dae4ee7c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:24.546268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff9ae-f0e7-432e-9d6e-26dae4ee7c51 None admin] PATH_INFO: `/v3/projects/cd73b02736584fbbb1e122093a7f6549` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:24.547590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeff9ae-f0e7-432e-9d6e-26dae4ee7c51 None admin] RBAC: Authorizing `identity:get_project(project_id=cd73b02736584fbbb1e122093a7f6549)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:24.549052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeff9ae-f0e7-432e-9d6e-26dae4ee7c51 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:24.550844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 574/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:24 2022] GET /identity/v3/projects/cd73b02736584fbbb1e122093a7f6549 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:24.559861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:24.571509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:24.670539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5b887-1f96-4705-94ef-2370060d7a0c None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:24.705502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9a9fc-b998-41be-ac3d-80c3c5a937b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:24.706265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a9fc-b998-41be-ac3d-80c3c5a937b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:24.706542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a9fc-b998-41be-ac3d-80c3c5a937b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:24.706818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9a9fc-b998-41be-ac3d-80c3c5a937b6 None admin] PATH_INFO: `/v3/projects/cd73b02736584fbbb1e122093a7f6549/users/d5fa204a34d84f84916e90d2f835e3e4/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:24.709009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a9fc-b998-41be-ac3d-80c3c5a937b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd73b02736584fbbb1e122093a7f6549, user_id=d5fa204a34d84f84916e90d2f835e3e4, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:24.710483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9a9fc-b998-41be-ac3d-80c3c5a937b6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:24.726707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 579/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:09:24 2022] PUT /identity/v3/projects/cd73b02736584fbbb1e122093a7f6549/users/d5fa204a34d84f84916e90d2f835e3e4/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:09:26.668910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6178-5f3e-481b-a77a-23d9aee022d9 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:26.669744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6178-5f3e-481b-a77a-23d9aee022d9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:26.669744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be6178-5f3e-481b-a77a-23d9aee022d9 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:26.671984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 575/1154] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:26.677291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddd32a-1590-4421-b61e-0e5d3801adcc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:26.677736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddd32a-1590-4421-b61e-0e5d3801adcc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:26.677843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddd32a-1590-4421-b61e-0e5d3801adcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:26.696578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-20ddd32a-1590-4421-b61e-0e5d3801adcc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:26.697770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-20ddd32a-1590-4421-b61e-0e5d3801adcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:26.773236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:26.781076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 580/1155] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:26.809706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be6178-5f3e-481b-a77a-23d9aee022d9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:26.923813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be6178-5f3e-481b-a77a-23d9aee022d9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:26.959526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:26.960157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:26.960439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:26.960709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:26.972051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:09:26.976897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:26.977990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:09:26.978992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 576/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:09:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:26.985969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddd32a-1590-4421-b61e-0e5d3801adcc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:27.087086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddd32a-1590-4421-b61e-0e5d3801adcc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:27.124740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:27.125345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:27.125610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:27.125888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:27.126626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:27.126930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:27.128298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:27.136315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 581/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:27.142798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:27.180166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:27.250524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cda03-7a30-4283-bac2-578f342b2a12 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:27.285382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:27.286042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:27.286322 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:27.286590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] PATH_INFO: `/v3/users/d5fa204a34d84f84916e90d2f835e3e4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:27.287902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] RBAC: Authorizing `identity:get_user(user_id=d5fa204a34d84f84916e90d2f835e3e4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:27.289349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:27.290997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 577/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:27 2022] GET /identity/v3/users/d5fa204a34d84f84916e90d2f835e3e4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:27.300515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:27.366436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:27.408677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa0c46-0b07-4632-82e8-04be49a24b51 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:27.458285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:27.458910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:27.459189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:27.459464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:27.532810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:27.534306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:27.592095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:27.639919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 582/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:27.646350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:27.762247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:27.766313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0ff7b-2854-4c59-8508-2e1c31845451 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:27.801180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1924c-d840-4263-a57b-df0086dd0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:27.801814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1924c-d840-4263-a57b-df0086dd0560 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:27.802121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1924c-d840-4263-a57b-df0086dd0560 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:27.802390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1924c-d840-4263-a57b-df0086dd0560 None admin] PATH_INFO: `/v3/projects/cd73b02736584fbbb1e122093a7f6549` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:27.803659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1924c-d840-4263-a57b-df0086dd0560 None admin] RBAC: Authorizing `identity:get_project(project_id=cd73b02736584fbbb1e122093a7f6549)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:27.805115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1924c-d840-4263-a57b-df0086dd0560 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:27.806800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 578/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:27 2022] GET /identity/v3/projects/cd73b02736584fbbb1e122093a7f6549 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:27.813172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:27.914195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28dd6a-0c8b-43d0-9a01-e190050fa29e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:27.949280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced573d-2b19-44f3-892c-3291111a7925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:27.949871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced573d-2b19-44f3-892c-3291111a7925 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:27.950173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced573d-2b19-44f3-892c-3291111a7925 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:27.950438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced573d-2b19-44f3-892c-3291111a7925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:27.951216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced573d-2b19-44f3-892c-3291111a7925 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=cd73b02736584fbbb1e122093a7f6549, user.id=d5fa204a34d84f84916e90d2f835e3e4) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:27.951525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced573d-2b19-44f3-892c-3291111a7925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:27.952973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced573d-2b19-44f3-892c-3291111a7925 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:27.958859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 583/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:09:27 2022] GET /identity/v3/role_assignments?user.id=d5fa204a34d84f84916e90d2f835e3e4&scope.project.id=cd73b02736584fbbb1e122093a7f6549&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:29.925121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369194d-579d-43b4-8cd1-705b33e07bca None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:29.925739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369194d-579d-43b4-8cd1-705b33e07bca None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:29.925739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369194d-579d-43b4-8cd1-705b33e07bca None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:29.927069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 579/1162] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:29.933306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39b88-e301-4453-809c-12dd9201f282 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:29.934014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39b88-e301-4453-809c-12dd9201f282 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:29.934219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de39b88-e301-4453-809c-12dd9201f282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:29.960237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8de39b88-e301-4453-809c-12dd9201f282 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:29.961417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8de39b88-e301-4453-809c-12dd9201f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:29.980027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:30.031340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 584/1163] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:30.053238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369194d-579d-43b4-8cd1-705b33e07bca None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:30.164913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369194d-579d-43b4-8cd1-705b33e07bca None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:30.199945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:30.200478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:30.200748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:30.201014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:30.234815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:30.273859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:30.275369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:30.375122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 580/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:30.382288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de39b88-e301-4453-809c-12dd9201f282 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:30.490427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de39b88-e301-4453-809c-12dd9201f282 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:30.532647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be068d-23bb-4849-9d22-a4c56c24c76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:30.533299 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be068d-23bb-4849-9d22-a4c56c24c76d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:30.533569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be068d-23bb-4849-9d22-a4c56c24c76d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:30.533833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be068d-23bb-4849-9d22-a4c56c24c76d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:30.541382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be068d-23bb-4849-9d22-a4c56c24c76d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:30.542872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be068d-23bb-4849-9d22-a4c56c24c76d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d6be068d-23bb-4849-9d22-a4c56c24c76d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:30.554906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:30.556063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:09:30.556955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 585/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:09:30 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:30.562471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:30.628879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:30.663661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7879d-4e83-4334-9246-c29ed7d50ec3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:30.707327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452b676-cd13-4186-8fbd-2191954d1fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:30.707944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b676-cd13-4186-8fbd-2191954d1fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:30.708225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b676-cd13-4186-8fbd-2191954d1fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:30.708494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452b676-cd13-4186-8fbd-2191954d1fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:30.709189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b676-cd13-4186-8fbd-2191954d1fa6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:30.709493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b676-cd13-4186-8fbd-2191954d1fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:30.710950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452b676-cd13-4186-8fbd-2191954d1fa6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:30.717835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 581/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Sat Aug 6 01:09:30 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:32.694500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439272-ee77-4502-8d04-3f4a6c2574ad None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:32.695389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439272-ee77-4502-8d04-3f4a6c2574ad None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:32.695389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00439272-ee77-4502-8d04-3f4a6c2574ad None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:32.697565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 586/1167] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:32.703099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca0bc-21d5-45c5-b205-09d8bb3f7cc7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:32.703538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca0bc-21d5-45c5-b205-09d8bb3f7cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:32.703640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ca0bc-21d5-45c5-b205-09d8bb3f7cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:32.723204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-148ca0bc-21d5-45c5-b205-09d8bb3f7cc7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:32.724401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-148ca0bc-21d5-45c5-b205-09d8bb3f7cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:32.803293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 582/1168] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:32.836033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00439272-ee77-4502-8d04-3f4a6c2574ad None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:32.860517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:32.948564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00439272-ee77-4502-8d04-3f4a6c2574ad None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:32.986951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c14df-921d-4a22-8f7f-c37007aef73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:32.987556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c14df-921d-4a22-8f7f-c37007aef73a None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:32.987801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c14df-921d-4a22-8f7f-c37007aef73a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:32.988087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c14df-921d-4a22-8f7f-c37007aef73a None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:32.988788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c14df-921d-4a22-8f7f-c37007aef73a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:32.990199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c14df-921d-4a22-8f7f-c37007aef73a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:33.008008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 587/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Sat Aug 6 01:09:32 2022] POST /identity/v3/domains => generated 267 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:09:34.993061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538a36-9d6e-49c7-ada4-74e511113c40 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:34.993611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538a36-9d6e-49c7-ada4-74e511113c40 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:34.993611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538a36-9d6e-49c7-ada4-74e511113c40 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:34.995020 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 583/1170] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:35.001312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d914-467e-4f88-a6f1-63d34bdca483 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:35.002048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d914-467e-4f88-a6f1-63d34bdca483 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:35.002268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0d914-467e-4f88-a6f1-63d34bdca483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:35.026179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-38e0d914-467e-4f88-a6f1-63d34bdca483 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:35.027388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-38e0d914-467e-4f88-a6f1-63d34bdca483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:35.097903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 588/1171] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:35.121087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1538a36-9d6e-49c7-ada4-74e511113c40 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:35.192823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:35.239450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1538a36-9d6e-49c7-ada4-74e511113c40 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:35.283156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028c06b-3bf8-42b9-80c1-852e02aaecdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:35.283732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c06b-3bf8-42b9-80c1-852e02aaecdd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:35.284011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c06b-3bf8-42b9-80c1-852e02aaecdd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:35.284283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028c06b-3bf8-42b9-80c1-852e02aaecdd None admin] PATH_INFO: `/v3/domains/100308c3049041939847ece8ea58cae9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:35.296258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c06b-3bf8-42b9-80c1-852e02aaecdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=100308c3049041939847ece8ea58cae9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:35.297724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e028c06b-3bf8-42b9-80c1-852e02aaecdd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:35.299351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 584/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Aug 6 01:09:35 2022] GET /identity/v3/domains/100308c3049041939847ece8ea58cae9 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:35.305391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d914-467e-4f88-a6f1-63d34bdca483 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:35.308584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:35.418951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0d914-467e-4f88-a6f1-63d34bdca483 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:35.453193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08749541-002f-4a82-a190-e6c510399a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:35.453804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08749541-002f-4a82-a190-e6c510399a1c None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:35.454103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08749541-002f-4a82-a190-e6c510399a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:35.454378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08749541-002f-4a82-a190-e6c510399a1c None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:35.455063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08749541-002f-4a82-a190-e6c510399a1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:35.456490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08749541-002f-4a82-a190-e6c510399a1c None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:35.485912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 589/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:09:35 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:09:37.496080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc00be-0064-44d3-a71f-38a7c0c9d80d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:37.496638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc00be-0064-44d3-a71f-38a7c0c9d80d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:37.496638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc00be-0064-44d3-a71f-38a7c0c9d80d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:37.498298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 585/1174] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:37.503820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd80c-dbd6-4fb5-9bbd-79677df7828c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:37.504246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd80c-dbd6-4fb5-9bbd-79677df7828c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:37.504355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dd80c-dbd6-4fb5-9bbd-79677df7828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:37.523523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9d9dd80c-dbd6-4fb5-9bbd-79677df7828c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:37.524713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9d9dd80c-dbd6-4fb5-9bbd-79677df7828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:37.577458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:37.596366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 590/1175] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:37.631518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc00be-0064-44d3-a71f-38a7c0c9d80d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:37.754491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc00be-0064-44d3-a71f-38a7c0c9d80d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:37.774374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:37.791109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f43707-f409-4121-b4ca-911173831bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:37.791748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f43707-f409-4121-b4ca-911173831bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:37.792026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f43707-f409-4121-b4ca-911173831bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:37.792295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f43707-f409-4121-b4ca-911173831bd8 None admin] PATH_INFO: `/v3/domains/100308c3049041939847ece8ea58cae9` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:37.793494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f43707-f409-4121-b4ca-911173831bd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=100308c3049041939847ece8ea58cae9)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:37.795010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f43707-f409-4121-b4ca-911173831bd8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:37.796772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 586/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Sat Aug 6 01:09:37 2022] GET /identity/v3/domains/100308c3049041939847ece8ea58cae9 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:37.803427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dd80c-dbd6-4fb5-9bbd-79677df7828c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:37.909149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dd80c-dbd6-4fb5-9bbd-79677df7828c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:37.944662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44199a8a-0255-4c30-890c-8a2eca2c9caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:37.945284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199a8a-0255-4c30-890c-8a2eca2c9caf None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:37.945561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199a8a-0255-4c30-890c-8a2eca2c9caf None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:37.945835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44199a8a-0255-4c30-890c-8a2eca2c9caf None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:37.946561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44199a8a-0255-4c30-890c-8a2eca2c9caf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:37.948010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44199a8a-0255-4c30-890c-8a2eca2c9caf None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:37.973331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 591/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:09:37 2022] POST /identity/v3/users => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:09:39.981617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4096ea-1ffc-4803-9251-516bb73f93e3 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:39.982203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4096ea-1ffc-4803-9251-516bb73f93e3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:39.982203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4096ea-1ffc-4803-9251-516bb73f93e3 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:39.983605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 587/1178] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:39.989898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6fc24-64dd-4462-846d-40e3a88e45bf None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:39.990659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6fc24-64dd-4462-846d-40e3a88e45bf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:39.990834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6fc24-64dd-4462-846d-40e3a88e45bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:40.014192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-13d6fc24-64dd-4462-846d-40e3a88e45bf None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:40.015437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-13d6fc24-64dd-4462-846d-40e3a88e45bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:40.054245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:40.098507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 592/1179] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:40.122336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4096ea-1ffc-4803-9251-516bb73f93e3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:40.236894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4096ea-1ffc-4803-9251-516bb73f93e3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:40.272132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:40.272768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:40.273045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:40.273319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:40.286336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:09:40.291162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:40.292250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:09:40.293123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 588/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:40.298653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6fc24-64dd-4462-846d-40e3a88e45bf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:40.399380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6fc24-64dd-4462-846d-40e3a88e45bf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:40.436031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:40.436668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:40.436944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:40.437219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:40.437964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:40.438270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:40.439649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:40.447739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 593/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:09:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:40.454079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:40.517716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:40.572064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c60bde-b085-4289-88e0-fe8f4ed010aa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:40.609274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:40.609963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:40.610239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:40.610504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] PATH_INFO: `/v3/users/72f6da2007a54ecc8ee098075baac95d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:40.624284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] RBAC: Authorizing `identity:get_user(user_id=72f6da2007a54ecc8ee098075baac95d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:40.625753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:40.627398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 589/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:40 2022] GET /identity/v3/users/72f6da2007a54ecc8ee098075baac95d => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:40.633552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:40.679541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:40.750977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864064b7-0eb6-49cc-81b7-3bc6e6171f50 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:40.788493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:40.789038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:40.789318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:40.789587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:40.858343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:40.859779 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:40.892634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:40.958263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 594/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:40.967731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:41.079782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ad169-1a1c-48ab-b4b9-0db7dbfb2a72 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:41.086891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:41.115448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859c3e6-ccbd-4328-bb9c-dbb92b028e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:41.116085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c3e6-ccbd-4328-bb9c-dbb92b028e8e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:41.116370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c3e6-ccbd-4328-bb9c-dbb92b028e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:41.116639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859c3e6-ccbd-4328-bb9c-dbb92b028e8e None admin] PATH_INFO: `/v3/projects/7dd68e379d6244efb7d8055a1a74486a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:41.117859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859c3e6-ccbd-4328-bb9c-dbb92b028e8e None admin] RBAC: Authorizing `identity:get_project(project_id=7dd68e379d6244efb7d8055a1a74486a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:41.119346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859c3e6-ccbd-4328-bb9c-dbb92b028e8e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:41.121016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 590/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:40 2022] GET /identity/v3/projects/7dd68e379d6244efb7d8055a1a74486a => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:41.128979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:41.238087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a88022-9aab-47da-a4ba-49a4117ab34d None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:41.272155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec620-a564-40fa-b1be-e6e919bc04ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:41.272756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec620-a564-40fa-b1be-e6e919bc04ec None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:41.273028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec620-a564-40fa-b1be-e6e919bc04ec None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:41.273293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec620-a564-40fa-b1be-e6e919bc04ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:41.274098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec620-a564-40fa-b1be-e6e919bc04ec None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=7dd68e379d6244efb7d8055a1a74486a, user.id=72f6da2007a54ecc8ee098075baac95d) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:41.274404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec620-a564-40fa-b1be-e6e919bc04ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:41.275840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec620-a564-40fa-b1be-e6e919bc04ec None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:41.278024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:41.282564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 595/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:09:41 2022] GET /identity/v3/role_assignments?user.id=72f6da2007a54ecc8ee098075baac95d&scope.project.id=7dd68e379d6244efb7d8055a1a74486a&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:43.218316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f0c5-39a1-400f-9384-649db96438bc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:43.218920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f0c5-39a1-400f-9384-649db96438bc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:43.218920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f0c5-39a1-400f-9384-649db96438bc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:43.220233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 591/1186] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:43.226595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74488f-7335-4d97-8fc7-4a0d0dd35095 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:43.227306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74488f-7335-4d97-8fc7-4a0d0dd35095 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:43.227533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74488f-7335-4d97-8fc7-4a0d0dd35095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:43.250227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9e74488f-7335-4d97-8fc7-4a0d0dd35095 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:43.251440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9e74488f-7335-4d97-8fc7-4a0d0dd35095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:43.331677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 596/1187] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:09:43.364206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101f0c5-39a1-400f-9384-649db96438bc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:43.473026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101f0c5-39a1-400f-9384-649db96438bc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:43.510991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:43.511981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:43.512345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:43.512679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:43.529649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:09:43.534649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:43.535780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:09:43.536684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 592/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:09:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:43.542049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74488f-7335-4d97-8fc7-4a0d0dd35095 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:43.648369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74488f-7335-4d97-8fc7-4a0d0dd35095 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:43.675392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:43.685354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:43.686031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:43.686338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:43.686610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:43.687335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:43.687641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:43.689016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:43.697945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 597/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:09:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:43.704052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:43.739282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:43.809300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a378693-d2f7-4336-b1fe-083ca5adc0d9 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:43.844454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:43.845077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:43.845352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:43.845626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] PATH_INFO: `/v3/users/72f6da2007a54ecc8ee098075baac95d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:43.846879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] RBAC: Authorizing `identity:get_user(user_id=72f6da2007a54ecc8ee098075baac95d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:43.848318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:43.849895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 593/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:43 2022] GET /identity/v3/users/72f6da2007a54ecc8ee098075baac95d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:09:43.858847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:43.966760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bdd2b-6079-48fd-8376-c0f6e9f3a38a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:44.004330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58727310-dc45-4a12-bc6b-3750f45b7a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:44.005202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727310-dc45-4a12-bc6b-3750f45b7a52 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:44.005640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727310-dc45-4a12-bc6b-3750f45b7a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:44.006105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58727310-dc45-4a12-bc6b-3750f45b7a52 None admin] PATH_INFO: `/v3/projects/7dd68e379d6244efb7d8055a1a74486a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:44.008551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58727310-dc45-4a12-bc6b-3750f45b7a52 None admin] RBAC: Authorizing `identity:get_project(project_id=7dd68e379d6244efb7d8055a1a74486a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:44.010905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58727310-dc45-4a12-bc6b-3750f45b7a52 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:44.013538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 598/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:43 2022] GET /identity/v3/projects/7dd68e379d6244efb7d8055a1a74486a => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:44.019436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:44.141777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dc1a8-6e2b-4ebe-8d2a-17c5077c05d5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:44.143358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:44.186298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265756b6-fa2c-4417-b931-aa1ea1698f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:44.187271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265756b6-fa2c-4417-b931-aa1ea1698f13 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:44.187618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265756b6-fa2c-4417-b931-aa1ea1698f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:44.187962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265756b6-fa2c-4417-b931-aa1ea1698f13 None admin] PATH_INFO: `/v3/projects/7dd68e379d6244efb7d8055a1a74486a/users/72f6da2007a54ecc8ee098075baac95d/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:44.191503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265756b6-fa2c-4417-b931-aa1ea1698f13 None admin] RBAC: Authorizing `identity:create_grant(project_id=7dd68e379d6244efb7d8055a1a74486a, user_id=72f6da2007a54ecc8ee098075baac95d, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:44.193801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265756b6-fa2c-4417-b931-aa1ea1698f13 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:44.212615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 594/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:09:44 2022] PUT /identity/v3/projects/7dd68e379d6244efb7d8055a1a74486a/users/72f6da2007a54ecc8ee098075baac95d/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:09:46.150923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f83f-e0a0-45a0-b892-f4eb0a250d9b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:46.151812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f83f-e0a0-45a0-b892-f4eb0a250d9b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:46.151812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894f83f-e0a0-45a0-b892-f4eb0a250d9b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:46.154366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 599/1193] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:09:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:09:46.162190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f965-36f4-44cb-92da-cc3eb6579477 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:46.162621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f965-36f4-44cb-92da-cc3eb6579477 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:46.162726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4293f965-36f4-44cb-92da-cc3eb6579477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:46.186211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4293f965-36f4-44cb-92da-cc3eb6579477 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:09:46.187458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4293f965-36f4-44cb-92da-cc3eb6579477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:09:46.257354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 595/1194] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:09:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 06 01:09:46.283667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894f83f-e0a0-45a0-b892-f4eb0a250d9b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:46.358819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:46.410653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894f83f-e0a0-45a0-b892-f4eb0a250d9b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:46.445559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:46.446232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:46.446515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:46.446787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:46.457734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:09:46.462687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:09:46.463740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:09:46.464615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 600/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:09:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:09:46.472125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f965-36f4-44cb-92da-cc3eb6579477 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:46.566287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:46.576449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4293f965-36f4-44cb-92da-cc3eb6579477 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:46.611522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:46.612134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:46.612408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:46.612683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:46.613409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:46.613714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:46.615162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:46.623346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 596/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:09:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:46.629507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:46.738009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8a5df-69e1-42f4-a853-65c900aaee54 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:46.756269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:46.775165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:46.775806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:46.776081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:46.776352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] PATH_INFO: `/v3/users/72f6da2007a54ecc8ee098075baac95d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:46.778024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] RBAC: Authorizing `identity:get_user(user_id=72f6da2007a54ecc8ee098075baac95d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:46.779468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:46.781132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 601/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Sat Aug 6 01:09:46 2022] GET /identity/v3/users/72f6da2007a54ecc8ee098075baac95d => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:09:46.787195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:46.894581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd29438-16ef-4ce5-8541-c851549a8cd5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:46.929601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:46.930244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:46.930527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:46.930798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:46.955008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:46.999550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:47.000954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:47.113699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 597/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:09:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:09:47.119926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:47.223483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb80d95-bc2e-4289-896b-05081242cdab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:47.261272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdad7f6-6206-4ab1-a84d-e1f14126384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:47.261840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad7f6-6206-4ab1-a84d-e1f14126384a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:47.262146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad7f6-6206-4ab1-a84d-e1f14126384a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:47.262421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdad7f6-6206-4ab1-a84d-e1f14126384a None admin] PATH_INFO: `/v3/projects/7dd68e379d6244efb7d8055a1a74486a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:47.263702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdad7f6-6206-4ab1-a84d-e1f14126384a None admin] RBAC: Authorizing `identity:get_project(project_id=7dd68e379d6244efb7d8055a1a74486a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:47.265460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdad7f6-6206-4ab1-a84d-e1f14126384a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:47.267179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 602/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Sat Aug 6 01:09:47 2022] GET /identity/v3/projects/7dd68e379d6244efb7d8055a1a74486a => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:47.274132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:09:47.335549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:47.381923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a95199-14c5-4d72-9bee-21ca98606ca3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:09:47.418424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56c270-e607-483c-ac73-abffd112dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:09:47.419041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c270-e607-483c-ac73-abffd112dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:09:47.419317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c270-e607-483c-ac73-abffd112dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:09:47.419607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56c270-e607-483c-ac73-abffd112dfa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:09:47.420412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56c270-e607-483c-ac73-abffd112dfa0 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=7dd68e379d6244efb7d8055a1a74486a, user.id=72f6da2007a54ecc8ee098075baac95d) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:09:47.420726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56c270-e607-483c-ac73-abffd112dfa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:09:47.422201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56c270-e607-483c-ac73-abffd112dfa0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:09:47.428857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 598/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:09:47 2022] GET /identity/v3/role_assignments?user.id=72f6da2007a54ecc8ee098075baac95d&scope.project.id=7dd68e379d6244efb7d8055a1a74486a&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:09:57.256423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=73 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:09:57.425621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=41 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:42.189576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1558-fe35-48bb-8564-3deca11de1cb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:42.190244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1558-fe35-48bb-8564-3deca11de1cb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:42.190244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1558-fe35-48bb-8564-3deca11de1cb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:42.191696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 603/1201] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:10:42.198280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488afb44-1614-42e2-8ed9-b3c602c431af None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:42.198882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488afb44-1614-42e2-8ed9-b3c602c431af None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:42.198882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488afb44-1614-42e2-8ed9-b3c602c431af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:42.223821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-488afb44-1614-42e2-8ed9-b3c602c431af None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:10:42.225173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-488afb44-1614-42e2-8ed9-b3c602c431af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:10:42.298028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 599/1202] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:10:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:10:42.327125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1558-fe35-48bb-8564-3deca11de1cb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:42.464071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1558-fe35-48bb-8564-3deca11de1cb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:42.509104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:42.509959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:42.510173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:42.510450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:42.528836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:42.530771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:42.550056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:42.551129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:42.552114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:42.552114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:42.552114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:42.552114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:42.552114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 604/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:10:42.559055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488afb44-1614-42e2-8ed9-b3c602c431af None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:42.691635 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488afb44-1614-42e2-8ed9-b3c602c431af None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:42.728393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:42.735525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b195d-947f-472f-84a1-4cdaee748928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:42.736468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b195d-947f-472f-84a1-4cdaee748928 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:42.736832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b195d-947f-472f-84a1-4cdaee748928 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:42.737113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b195d-947f-472f-84a1-4cdaee748928 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:42.737889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b195d-947f-472f-84a1-4cdaee748928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:42.738239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b195d-947f-472f-84a1-4cdaee748928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:42.739658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b195d-947f-472f-84a1-4cdaee748928 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:42.757185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 600/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:42.763094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:42.825826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:42.884005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309232b-0794-4707-8fdd-99f7e912fac4 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:42.926795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a52d1-d07c-4093-a65e-1b93438d8e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:42.928174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a52d1-d07c-4093-a65e-1b93438d8e64 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:42.928174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a52d1-d07c-4093-a65e-1b93438d8e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:42.928174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a52d1-d07c-4093-a65e-1b93438d8e64 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:42.928827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a52d1-d07c-4093-a65e-1b93438d8e64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:42.930384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a52d1-d07c-4093-a65e-1b93438d8e64 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:42.961980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 605/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Sat Aug 6 01:10:42 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:10:45.276422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b486-3135-4266-86fb-8fc1ae74df78 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:45.277042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b486-3135-4266-86fb-8fc1ae74df78 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:45.277042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734b486-3135-4266-86fb-8fc1ae74df78 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:45.278689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 601/1206] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:10:45.284727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebf271-2ab4-49b9-98b6-21b42d214ebd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:45.285177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebf271-2ab4-49b9-98b6-21b42d214ebd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:45.285284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebf271-2ab4-49b9-98b6-21b42d214ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:45.305559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6eebf271-2ab4-49b9-98b6-21b42d214ebd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:10:45.306791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6eebf271-2ab4-49b9-98b6-21b42d214ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:10:45.376171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 606/1207] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:10:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:10:45.400721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734b486-3135-4266-86fb-8fc1ae74df78 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:45.520146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734b486-3135-4266-86fb-8fc1ae74df78 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:45.559631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:45.560159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:45.560446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:45.560719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:45.573177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:10:45.578581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:45.579975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:45.581516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 602/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:10:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:45.585896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebf271-2ab4-49b9-98b6-21b42d214ebd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:45.631272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:45.695623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebf271-2ab4-49b9-98b6-21b42d214ebd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:45.733763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:45.734833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:45.735388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:45.735734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:45.736571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:45.736924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:45.738416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:45.748690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 607/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:10:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:45.754459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:45.811992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:45.874008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bb926-95f7-4dcf-9757-4a9b04f60d43 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:45.911873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:45.912571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:45.912848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:45.913086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:45.925589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:45.927173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:45.944007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:45.950918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:45.951894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:45.951894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:45.951894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:45.951894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:45.951894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 603/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:10:45.952219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:46.068709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:46.072602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd238d-a056-491b-b3fe-7399ac8a6fd2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:46.111009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:46.111759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:46.112115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:46.112378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:46.113190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:46.113500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:46.116760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:46.128324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 608/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:46.134713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:46.261332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5951e4e-1944-4255-afab-ac33b3fe3340 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:46.262926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:46.298594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:46.299258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:46.299483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:46.299813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:46.307565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:46.309033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:10:46.320663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:46.321672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:46.322862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:46.326589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 604/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:46.328373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:46.438482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ad7dc-848f-4060-9e09-48a98bba5b81 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:46.477593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:46.478304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:46.478569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:46.479864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:46.479864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:46.480065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:46.481332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:46.499952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 609/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 01:10:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:46.505586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:46.619783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3feb6-3b93-43ae-8b93-fcb708e3ed96 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:46.656850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:46.657641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:46.658061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:46.658436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:46.691793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:46.738202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:46.739718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:46.865963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 605/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:10:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:10:46.871497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:46.893156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:46.994473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d9ec6-1891-4e56-a1c7-22faf3925169 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:47.039106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:47.039843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:47.040189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:47.040607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:47.052249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:47.054067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:47.072539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:47.073686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:47.074843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:47.074843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:47.074843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:47.074843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:47.078116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 610/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:47.081582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:47.147169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:47.190909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c2f10-4ea2-4881-9f3b-538ec9e19b2a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:47.237861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:47.238780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:47.239186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:47.239629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:47.240468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:47.240843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:47.242443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:47.254633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 606/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:47.266885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:47.350097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:47.386512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b77e9f-6434-487a-8afd-98039700da79 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:47.431485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:47.432483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:47.432766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:47.433041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:47.442376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:47.443877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:10:47.463156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:47.464283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:47.465285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 611/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:10:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:10:47.470414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:47.589773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc88b30-20e3-4755-8d03-586c04724abd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:47.614293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:47.630731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5917783-b6c8-45b8-a8a0-090167e4a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:47.631456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917783-b6c8-45b8-a8a0-090167e4a697 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:47.631838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917783-b6c8-45b8-a8a0-090167e4a697 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:47.632210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5917783-b6c8-45b8-a8a0-090167e4a697 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:47.632973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917783-b6c8-45b8-a8a0-090167e4a697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:47.633434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917783-b6c8-45b8-a8a0-090167e4a697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:47.634934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5917783-b6c8-45b8-a8a0-090167e4a697 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:47.650430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 607/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:10:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:10:47.656554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:47.781228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe56ba-77c7-4534-8f2b-84ecaafecac6 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:47.814942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:47.822310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e240cb-c88c-40fe-bc81-06b50fb89342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:47.823236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e240cb-c88c-40fe-bc81-06b50fb89342 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:47.823624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e240cb-c88c-40fe-bc81-06b50fb89342 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:47.823937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e240cb-c88c-40fe-bc81-06b50fb89342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:47.824814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e240cb-c88c-40fe-bc81-06b50fb89342 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=aeb7cecc526443cb9d854c7104a79a66) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:47.825207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e240cb-c88c-40fe-bc81-06b50fb89342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:47.826913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e240cb-c88c-40fe-bc81-06b50fb89342 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:47.833990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 612/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:10:47 2022] GET /identity/v3/role_assignments?user.id=aeb7cecc526443cb9d854c7104a79a66&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:49.911159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb198764-f68b-4ce3-a921-e5bc2d4a9a68 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:49.911715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb198764-f68b-4ce3-a921-e5bc2d4a9a68 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:49.911715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb198764-f68b-4ce3-a921-e5bc2d4a9a68 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:49.913089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 608/1220] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:10:49.918517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4d29-5066-469a-9a58-6dce1889c5fe None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:49.918943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4d29-5066-469a-9a58-6dce1889c5fe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:49.919075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4d29-5066-469a-9a58-6dce1889c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:49.938087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-af1e4d29-5066-469a-9a58-6dce1889c5fe None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:10:49.939471 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-af1e4d29-5066-469a-9a58-6dce1889c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:10:50.014995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 613/1221] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:10:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:10:50.037543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb198764-f68b-4ce3-a921-e5bc2d4a9a68 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:50.154872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb198764-f68b-4ce3-a921-e5bc2d4a9a68 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:50.195823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:50.196761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:50.197002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:50.197424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:50.212142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:10:50.218544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:50.219547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:50.220918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 609/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:10:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:50.226500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4d29-5066-469a-9a58-6dce1889c5fe None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:50.335783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4d29-5066-469a-9a58-6dce1889c5fe None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:50.360511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:50.373950 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:50.374639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:50.375110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:50.375444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:50.377333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] RBAC: Adding query filter params (name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:50.377707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:50.379321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:50.390281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 614/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:10:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:50.396610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:50.444913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:50.506608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf38be-4116-4e0c-b5a8-53a69aae36b5 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:50.544056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:50.544680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:50.544984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:50.545242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:50.556187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:50.557666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:50.575153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:50.576249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:50.577310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:50.577310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:50.577310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:50.577310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:50.577310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 610/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:50.582670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:50.690182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c09b6-f575-4a4a-aba7-1d92cabd0750 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:50.725381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:50.726024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:50.726313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:50.726606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:50.727380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:50.727688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:50.729114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:50.742194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 615/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:50.748532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:50.852067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:50.861807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37c8f4-1c69-4288-b000-6d6ddd0edf91 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:50.894983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:50.895623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:50.895926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:50.896193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:50.904506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:50.906079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:10:50.917398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:50.918927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:50.919907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 611/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:50.924806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:50.974222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:51.035089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c2673-af69-40e2-bedb-84c9220d4058 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:51.074239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:51.074881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:51.075162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:51.075433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:51.076231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:51.076538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:51.078001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:51.097120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 616/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 01:10:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:10:51.103276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:51.210891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109070b-c077-48c5-91c3-9333e8639a83 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:51.249038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:51.249744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:51.250065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:51.250340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:51.262402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:51.263989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:51.279303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:51.280372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:51.281387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:51.281387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:51.281387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:51.281387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:51.281387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 612/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:51.288081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:51.392556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8282d46-51f7-4854-b09c-7860b06f141f None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:51.395017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:51.431598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:51.432266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:51.432550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:51.432899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:51.433690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:51.434100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:51.435711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:51.447386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 617/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:10:51.453547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:51.464436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:51.567402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7ed8-7e52-4730-a097-b8676aa1c2e0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:51.604996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:51.605645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:51.606010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:51.606282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:51.613711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:51.615314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:10:51.627486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:51.628742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:51.629837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 613/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:51.634691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:51.748127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21c008-8c29-42e4-ab3c-e9c4a872986a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:51.790089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06dfc0-4adc-4f14-8382-ba569f985e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:51.791150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06dfc0-4adc-4f14-8382-ba569f985e5b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:51.791501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06dfc0-4adc-4f14-8382-ba569f985e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:51.791838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06dfc0-4adc-4f14-8382-ba569f985e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:51.792850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06dfc0-4adc-4f14-8382-ba569f985e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:51.793532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06dfc0-4adc-4f14-8382-ba569f985e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:51.796271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06dfc0-4adc-4f14-8382-ba569f985e5b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:51.817329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 618/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:51.818964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:51.891203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:51.929758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c266774-1f85-4d2b-b120-6a0251c2d032 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:51.964548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079159bd-445c-46dd-bf46-0fb029c959e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:51.965225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079159bd-445c-46dd-bf46-0fb029c959e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:51.965509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079159bd-445c-46dd-bf46-0fb029c959e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:51.965785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079159bd-445c-46dd-bf46-0fb029c959e8 None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/aeb7cecc526443cb9d854c7104a79a66/roles/4cae790876e1492fbe3d3a314f0de80f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:51.981898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079159bd-445c-46dd-bf46-0fb029c959e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=aeb7cecc526443cb9d854c7104a79a66, role_id=4cae790876e1492fbe3d3a314f0de80f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:51.983450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079159bd-445c-46dd-bf46-0fb029c959e8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:51.997639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 614/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:10:51 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/aeb7cecc526443cb9d854c7104a79a66/roles/4cae790876e1492fbe3d3a314f0de80f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:10:54.164777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a33d0-bfc2-4d97-90ab-703e2813bf61 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:54.165345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a33d0-bfc2-4d97-90ab-703e2813bf61 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:54.165345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a33d0-bfc2-4d97-90ab-703e2813bf61 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:54.166742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 619/1233] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:10:54.172751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead77a8a-b847-4186-9d18-e493a202f7d2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:54.173190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead77a8a-b847-4186-9d18-e493a202f7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:54.173311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead77a8a-b847-4186-9d18-e493a202f7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:54.193441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ead77a8a-b847-4186-9d18-e493a202f7d2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:10:54.194713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ead77a8a-b847-4186-9d18-e493a202f7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:10:54.273078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 615/1234] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:10:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:10:54.302207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a33d0-bfc2-4d97-90ab-703e2813bf61 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:54.328598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:54.410860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a33d0-bfc2-4d97-90ab-703e2813bf61 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:54.445799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:54.446465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:54.446740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:54.447008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:54.458037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:10:54.463358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:54.464774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:54.465617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 620/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Sat Aug 6 01:10:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:54.470963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead77a8a-b847-4186-9d18-e493a202f7d2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:54.520313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:54.580517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead77a8a-b847-4186-9d18-e493a202f7d2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:54.616127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:54.616862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:54.617113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:54.617412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:54.618170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:54.618483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:54.620011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:54.633463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 616/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Sat Aug 6 01:10:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:54.634657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:54.724589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:54.741275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692075b-8365-4db6-90a5-1afa52765cf2 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:54.779610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:54.780217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:54.780516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:54.780785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:54.792047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:54.793502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:54.807963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:54.809119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:54.810089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:54.810089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:54.810089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:54.810089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:54.810089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 621/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:54.815741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:54.921866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce940-ad64-4713-9e52-018cff67aaf6 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:54.931959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:54.958256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:54.958892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:54.959172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:54.959451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:54.960152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:54.960460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:54.961869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:54.974743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 617/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:54.980582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:55.086681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840a940-c626-4d8a-bd7a-f971741068f3 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:55.129304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:55.129983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:55.130262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:55.130534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:55.133254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:55.139281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:55.141256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:10:55.153671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:55.154869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:55.156011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 622/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:55.161177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:55.280384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74545e1f-5630-4f57-a1fc-1412549d2df0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:55.319337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:55.320076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:55.320383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:55.320653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:55.321602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:55.322008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:55.323604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:55.342756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 618/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 01:10:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:55.348873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:55.454294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3c1e5-6ac1-454b-adfd-c8af3985745b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:55.489750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:55.490465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:55.490764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:55.491108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:55.560489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:55.568400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:55.569971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:55.680186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 623/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:10:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:10:55.686469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:55.715185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:55.792192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fc2cd-b299-46c6-be76-f7cfac06bf20 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:55.833234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:55.833234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:55.833234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:55.833234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:55.844780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:55.846424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:55.862957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:55.863923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:55.864807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:55.864807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:55.864807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:55.864807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:55.864807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 619/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:10:55.870341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:55.968512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:55.974925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21753e6f-05b0-4c18-8414-9c82493dd4ed None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:56.011180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:56.011807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:56.012078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:56.012344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:56.013135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:56.013451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:56.015023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:56.027224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 624/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:56.033073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:56.119472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:56.142111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b7cd3-ffe4-46f5-86a2-5b6a01a52035 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:56.177021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:56.177663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:56.177953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:56.178233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:56.185234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:56.186793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:10:56.198618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:56.200106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:10:56.201366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 620/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:10:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:10:56.206049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:56.320511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590b33-3e7f-4dec-95f8-9c5870900b98 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:56.358218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa630dcb-f33c-45be-8e5a-c1ad29ffb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:56.359007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630dcb-f33c-45be-8e5a-c1ad29ffb659 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:56.359110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630dcb-f33c-45be-8e5a-c1ad29ffb659 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:56.359377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630dcb-f33c-45be-8e5a-c1ad29ffb659 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:56.360137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa630dcb-f33c-45be-8e5a-c1ad29ffb659 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:56.360445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa630dcb-f33c-45be-8e5a-c1ad29ffb659 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:56.361934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa630dcb-f33c-45be-8e5a-c1ad29ffb659 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:56.380278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 625/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:10:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:56.381469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:56.502175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59895d-d935-439a-b1e5-d5f31264103e None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:56.539932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ab376-54ee-47d3-9c58-cb92813eb702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:56.540722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ab376-54ee-47d3-9c58-cb92813eb702 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:56.540976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ab376-54ee-47d3-9c58-cb92813eb702 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:56.541254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ab376-54ee-47d3-9c58-cb92813eb702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:56.542168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ab376-54ee-47d3-9c58-cb92813eb702 None admin] RBAC: Adding query filter params (role.id=4cae790876e1492fbe3d3a314f0de80f, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=aeb7cecc526443cb9d854c7104a79a66) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:56.542526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ab376-54ee-47d3-9c58-cb92813eb702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:56.544117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ab376-54ee-47d3-9c58-cb92813eb702 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:56.549916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 621/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:10:56 2022] GET /identity/v3/role_assignments?user.id=aeb7cecc526443cb9d854c7104a79a66&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=4cae790876e1492fbe3d3a314f0de80f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:58.746918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dddde6-a984-4d26-b1de-bd9336b6d6b6 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:58.747531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dddde6-a984-4d26-b1de-bd9336b6d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:58.747531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dddde6-a984-4d26-b1de-bd9336b6d6b6 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:58.748934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 626/1247] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:10:58.754381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3927adb-d629-4f7f-8585-f4563623ffb8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:58.754909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3927adb-d629-4f7f-8585-f4563623ffb8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:58.754909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3927adb-d629-4f7f-8585-f4563623ffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:58.761819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:58.775187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f3927adb-d629-4f7f-8585-f4563623ffb8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:10:58.777817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3927adb-d629-4f7f-8585-f4563623ffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:10:58.849194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 622/1248] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:10:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:10:58.876079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dddde6-a984-4d26-b1de-bd9336b6d6b6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:58.899419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:59.003521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dddde6-a984-4d26-b1de-bd9336b6d6b6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:59.039185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:59.039763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:59.040062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:59.040313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:59.050623 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:10:59.055498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:59.056681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:59.057706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 627/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:59.062988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3927adb-d629-4f7f-8585-f4563623ffb8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:59.173050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3927adb-d629-4f7f-8585-f4563623ffb8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:59.206128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:59.212003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:59.212730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:59.213089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:59.213381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:59.214306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:59.214915 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:59.217166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:59.232221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 623/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:10:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:59.232517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:59.319251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:59.351214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a77e1-3abf-4bf5-b8dc-d778063c38ab None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:59.391255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:59.391986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:59.392270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:59.392536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:59.403819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:59.405477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:10:59.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:59.423032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:59.424530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:10:59.424530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:10:59.424530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:10:59.424530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:59.424530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 628/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:59.429270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:59.542594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24e7e1-3318-4e7b-88b9-f6c8c002bef8 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:59.580016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:59.580607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:59.580938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:59.581244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:59.582052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:59.582389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:59.583909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:59.601873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 624/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:59.603154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:59.717501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba38c35-d17e-42e7-94c5-7b3ef40335ea None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:59.746702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:59.756673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:59.757442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:59.757631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:59.757978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:59.766251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:59.767807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:10:59.780443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:10:59.781698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:10:59.783016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 629/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:10:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:10:59.788698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:10:59.851248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:10:59.903618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b09d-92ca-4b48-85b8-3aa853836635 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:10:59.943276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:10:59.943891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:10:59.944171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:10:59.944498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:10:59.945372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:10:59.945747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:10:59.947249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:10:59.966664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 625/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 01:10:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:10:59.973780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:00.087944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ed91c-74d9-495e-a7bd-1c69b074d559 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:00.123429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:00.123970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:00.124248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:00.124516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:00.179373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:00.195045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:00.196953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:00.322615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 630/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:10:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:11:00.324006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:00.441153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b65c42-5077-4866-8b28-99867b52fdff None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:00.457628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:00.480397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:00.481124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:00.481406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:00.481680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:00.492916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:00.494457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:11:00.512477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:00.513513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:00.514805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:11:00.514805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:11:00.514805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:00.514805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:00.514805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 626/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:00.520450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:00.617691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:00.631090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739095ed-5f8a-4858-a440-c0ea60c7dd87 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:00.668300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:00.668960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:00.669239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:00.669508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:00.671442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:00.671772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:00.673151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:00.684797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 631/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:00.690942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:00.805788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad867d9-8552-425d-b8ed-173e52fda46a None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:00.842995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:00.843675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:00.843985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:00.844265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:00.851625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:00.853194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:11:00.867920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:00.869098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:00.870361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 627/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:11:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:00.875448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:00.981839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9cc08-8f52-4c5d-a65d-e60af2941cca None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:01.018727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f9547-6920-44dc-b050-6adb29aeb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:01.019413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9547-6920-44dc-b050-6adb29aeb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:01.019726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9547-6920-44dc-b050-6adb29aeb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:01.019993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f9547-6920-44dc-b050-6adb29aeb1c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:01.020853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f9547-6920-44dc-b050-6adb29aeb1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:01.021192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f9547-6920-44dc-b050-6adb29aeb1c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:01.022807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f9547-6920-44dc-b050-6adb29aeb1c2 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:01.036559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 632/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:01.043018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:01.071870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:01.160755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda70ab3-be06-404b-bdec-df9f3b94d366 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:01.201758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db9233-ea64-4ad0-8fbe-67b428b74008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:01.202460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db9233-ea64-4ad0-8fbe-67b428b74008 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:01.202714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db9233-ea64-4ad0-8fbe-67b428b74008 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:01.202963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db9233-ea64-4ad0-8fbe-67b428b74008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:01.203758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db9233-ea64-4ad0-8fbe-67b428b74008 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=aeb7cecc526443cb9d854c7104a79a66) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:01.204067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db9233-ea64-4ad0-8fbe-67b428b74008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:01.205533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db9233-ea64-4ad0-8fbe-67b428b74008 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:01.212003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 628/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:11:01 2022] GET /identity/v3/role_assignments?user.id=aeb7cecc526443cb9d854c7104a79a66&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1aa37aeab6694470b737775bf433503d => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:03.260014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc598ee-f654-40c6-a679-f025a71aae63 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:03.260541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc598ee-f654-40c6-a679-f025a71aae63 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:03.260541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc598ee-f654-40c6-a679-f025a71aae63 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:03.261909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 633/1261] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:11:03.267640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc1c7-12ca-40ee-b987-b03101ed8f31 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:03.268077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc1c7-12ca-40ee-b987-b03101ed8f31 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:03.268162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc1c7-12ca-40ee-b987-b03101ed8f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:03.287847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1d3dc1c7-12ca-40ee-b987-b03101ed8f31 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:11:03.289075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1d3dc1c7-12ca-40ee-b987-b03101ed8f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:11:03.357946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 629/1262] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:11:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:11:03.392628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc598ee-f654-40c6-a679-f025a71aae63 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:03.409584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:03.507044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc598ee-f654-40c6-a679-f025a71aae63 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:03.542213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:03.542755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:03.543026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:03.543294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:03.553378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:11:03.558288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:03.559350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:11:03.560385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 634/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:11:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 06 01:11:03.566533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc1c7-12ca-40ee-b987-b03101ed8f31 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:03.590083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:03.676255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc1c7-12ca-40ee-b987-b03101ed8f31 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:03.712781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:03.713402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:03.713687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:03.714033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:03.714704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:03.715008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:03.716399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:03.724614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 630/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:03.731190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:03.805569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:03.842010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2ae76-69d2-4e3c-b675-8d9062bff73e None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:03.879372 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:03.880002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:03.880276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:03.880548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:03.891078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:03.892522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:11:03.907944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:03.908956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:03.909996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:11:03.909996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:11:03.909996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:03.909996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:11:03.909996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 635/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:03.915385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:04.003288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:04.029107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec429b9-4e40-4deb-9b5b-6be03883c9c3 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:04.063107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:04.063645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:04.063875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:04.064177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:04.064869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:04.065172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:04.066624 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:04.078382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 631/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:04.087451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:04.196865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66396-3e0e-4fee-b201-48c6c473af0b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:04.218540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:04.234570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:04.235223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:04.235505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:04.235777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:04.243216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:04.244675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:11:04.255970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:04.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:11:04.258308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:11:04.262077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 636/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:11:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:04.263121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:04.388472 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786d2a5-84aa-4738-884a-789b9ae18ccd None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:04.423826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:04.424431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:04.424706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:04.424969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:04.425757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:04.426086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:04.427521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:04.436058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:04.449376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 632/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 01:11:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:11:04.455359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:04.558830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67d598-21ea-4da4-a2cf-e015dc8b0f6b None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:04.594199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:04.594833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:04.595109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:04.595376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:04.606254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:04.607698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:11:04.621976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:04.623002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:04.624105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:11:04.624105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:11:04.624105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:04.624105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:11:04.624105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 637/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:11:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:04.629586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:04.765679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df87e2-ee8d-4aaa-90c6-e14a95e980f0 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:04.800985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:04.801594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:04.801867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:04.802162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:04.802853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:04.803158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:04.804547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:04.815689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 633/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:04.822369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:04.857532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:04.929224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5f55f-874e-4c9f-8418-47849ca35753 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:04.966517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:04.967153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:04.967426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:04.967697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:04.974840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:04.976306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:11:04.987907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:04.988905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:11:04.989876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 638/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:04.997915 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:05.068050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:05.111463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39006aa4-7feb-4521-bc17-b50775fda7fa None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:05.145490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f3b1-e434-4adb-9356-4e4483d4bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:05.146125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f3b1-e434-4adb-9356-4e4483d4bcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:05.146402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f3b1-e434-4adb-9356-4e4483d4bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:05.146672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f3b1-e434-4adb-9356-4e4483d4bcc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:05.147420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f3b1-e434-4adb-9356-4e4483d4bcc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:05.147724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f3b1-e434-4adb-9356-4e4483d4bcc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:05.149542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f3b1-e434-4adb-9356-4e4483d4bcc0 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:05.161451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 634/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:05.167904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:05.269751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:05.279635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc0978-39f3-4b37-a813-56f16a4f0e45 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:05.314248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf387b5e-92b7-478a-9123-385a1c558ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:05.314989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387b5e-92b7-478a-9123-385a1c558ee0 None admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:05.315281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387b5e-92b7-478a-9123-385a1c558ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:05.315554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf387b5e-92b7-478a-9123-385a1c558ee0 None admin] PATH_INFO: `/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/aeb7cecc526443cb9d854c7104a79a66/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:05.317780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf387b5e-92b7-478a-9123-385a1c558ee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb6d28884407ab06b9f9d38f8e0e8, user_id=aeb7cecc526443cb9d854c7104a79a66, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:05.319354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf387b5e-92b7-478a-9123-385a1c558ee0 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:05.334443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 639/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Sat Aug 6 01:11:05 2022] PUT /identity/v3/projects/ee8cb6d28884407ab06b9f9d38f8e0e8/users/aeb7cecc526443cb9d854c7104a79a66/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:11:07.294212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3372-cee2-43a3-95c5-129d7c249877 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:07.295115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3372-cee2-43a3-95c5-129d7c249877 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:07.295115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb3372-cee2-43a3-95c5-129d7c249877 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:07.297288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 635/1274] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:11:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:11:07.303458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311a21-aaf6-4006-837b-8374fcbdc7f5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:07.304134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311a21-aaf6-4006-837b-8374fcbdc7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:07.304224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311a21-aaf6-4006-837b-8374fcbdc7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:07.332501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-77311a21-aaf6-4006-837b-8374fcbdc7f5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:11:07.333702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-77311a21-aaf6-4006-837b-8374fcbdc7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:11:07.408776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 640/1275] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:11:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:11:07.444650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3372-cee2-43a3-95c5-129d7c249877 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:07.576272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb3372-cee2-43a3-95c5-129d7c249877 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:07.593794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:07.613243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:07.613879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:07.614211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:07.614486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:07.625102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 06 01:11:07.630116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:07.631277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 06 01:11:07.632303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:07.634112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 636/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Sat Aug 6 01:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:07.637680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311a21-aaf6-4006-837b-8374fcbdc7f5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:07.724992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:07.747604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311a21-aaf6-4006-837b-8374fcbdc7f5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:07.785825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:07.786464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:07.786740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:07.787011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:07.787732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:07.788033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:07.789412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:07.798376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 641/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Sat Aug 6 01:11:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:11:07.804206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:07.906835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17a86c-73b1-496b-b6da-078e1e3895d1 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:07.948601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:07.949225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:07.949513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:07.949782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:07.960542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:07.962041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:11:07.976262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:07.977299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:07.985396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:11:07.985396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:11:07.985396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:07.985396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:07.985396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 637/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:07.985720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:08.092558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8e218-aa8e-403a-94f7-ec7dd18add69 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:08.127398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:08.128010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:08.128293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:08.128561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:08.129254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:08.129556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:08.130967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:08.149478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 642/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:08.155290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:08.193052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:08.271135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dfe1a-9401-4837-a732-4ea449abf2ca None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:08.306298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:08.306901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:08.307201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:08.307471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:08.315201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:08.316644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 06 01:11:08.327945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:08.328996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:08.330029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 638/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:11:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:08.335599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:08.341267 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:08.443414 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70248a7c-effa-4200-96d1-25070af4e602 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:08.479560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:08.480170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:08.480449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:08.480736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:08.481508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:08.481814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:08.483286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:08.501271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 643/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Sat Aug 6 01:11:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:08.507465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:08.600435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:08.611426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81291fb-f840-4acd-9235-b262929e0124 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:08.649219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:08.649825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:08.650139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:08.650412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:08.719961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:08.721408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:08.816003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:08.826963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 639/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Sat Aug 6 01:11:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 06 01:11:08.834224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:08.895337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:08.936329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e09328-33c9-4941-9fba-4ae58427506a None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:08.973595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:08.974188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:08.974462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:08.974729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:08.985169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:08.986679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 06 01:11:09.002485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:09.003403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:09.004439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 06 01:11:09.004439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 06 01:11:09.004439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 06 01:11:09.004439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:11:09.004439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 644/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:09.009745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:09.109762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f551d34-7a73-42ab-a9c0-bbc099ba6006 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:09.144960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:09.145564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:09.145849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:09.146153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:09.146848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:09.147150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:09.148875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:09.160561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 640/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Sat Aug 6 01:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:09.166593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:09.271718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda87eae-c9d5-47ec-91e7-1e4503fe9105 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:09.285297 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:09.305976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:09.306630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:09.306905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:09.307172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:09.313661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:09.315235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 06 01:11:09.326233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:09.327292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: ERROR keystone.server.flask.application Aug 06 01:11:09.328239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 645/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Sat Aug 6 01:11:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:09.333794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:09.383806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:09.434401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a63b18-6f23-45b2-983f-f06268354293 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:09.470375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05224e1-3b1f-4320-9ec1-93215212c9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:09.470983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05224e1-3b1f-4320-9ec1-93215212c9bf None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:09.471264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05224e1-3b1f-4320-9ec1-93215212c9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:09.471525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05224e1-3b1f-4320-9ec1-93215212c9bf None admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:09.472267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05224e1-3b1f-4320-9ec1-93215212c9bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:09.472570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05224e1-3b1f-4320-9ec1-93215212c9bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:09.473997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05224e1-3b1f-4320-9ec1-93215212c9bf None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:09.485778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 641/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Sat Aug 6 01:11:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:09.494494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:09.602643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ae8f7-9bba-4b90-9033-1d4cb202d603 None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:09.638524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ea189-8011-4b04-b2e6-82d157262ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:09.639129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ea189-8011-4b04-b2e6-82d157262ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:09.639405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ea189-8011-4b04-b2e6-82d157262ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:09.639681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ea189-8011-4b04-b2e6-82d157262ac1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:09.640463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ea189-8011-4b04-b2e6-82d157262ac1 None admin] RBAC: Adding query filter params (role.id=1aa37aeab6694470b737775bf433503d, scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8, user.id=aeb7cecc526443cb9d854c7104a79a66) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:09.640777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ea189-8011-4b04-b2e6-82d157262ac1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:09.642269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ea189-8011-4b04-b2e6-82d157262ac1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:09.649051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 646/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Sat Aug 6 01:11:09 2022] GET /identity/v3/role_assignments?user.id=aeb7cecc526443cb9d854c7104a79a66&scope.project.id=ee8cb6d28884407ab06b9f9d38f8e0e8&role.id=1aa37aeab6694470b737775bf433503d => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:11.643522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce931a-6017-4f62-bc28-b35111929b25 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:11.644069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce931a-6017-4f62-bc28-b35111929b25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:11.644069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce931a-6017-4f62-bc28-b35111929b25 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:11.645469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 642/1288] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:11:11.651207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5085b7-75fb-43d8-b4b4-903e559e4834 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:11.651644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5085b7-75fb-43d8-b4b4-903e559e4834 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:11.651735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5085b7-75fb-43d8-b4b4-903e559e4834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:11.671715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0e5085b7-75fb-43d8-b4b4-903e559e4834 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:11:11.672889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0e5085b7-75fb-43d8-b4b4-903e559e4834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:11:11.703592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:11.745431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 647/1289] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:11:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:11:11.767843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce931a-6017-4f62-bc28-b35111929b25 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:11.877883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce931a-6017-4f62-bc28-b35111929b25 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:11.889687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:11.917944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:11.918601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:11.918878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:11.919158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:11.919793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:11.921175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:11.930331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:11.931536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:11.932667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 643/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:11:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:11.937560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5085b7-75fb-43d8-b4b4-903e559e4834 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:12.035603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5085b7-75fb-43d8-b4b4-903e559e4834 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:12.068124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebf2b7-1d17-496d-a089-dfd813cac295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:12.068741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebf2b7-1d17-496d-a089-dfd813cac295 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:12.069017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebf2b7-1d17-496d-a089-dfd813cac295 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:12.069290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebf2b7-1d17-496d-a089-dfd813cac295 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:12.069972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebf2b7-1d17-496d-a089-dfd813cac295 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:12.070300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebf2b7-1d17-496d-a089-dfd813cac295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:12.071674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcebf2b7-1d17-496d-a089-dfd813cac295 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:12.076436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 648/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 01:11:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:11:12.082174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:12.183390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b721a-c0f3-4adf-ad0b-a7092c5e8e16 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:12.228726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fc8ec-02c3-4918-93a1-70efa4b52295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:12.229588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc8ec-02c3-4918-93a1-70efa4b52295 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:12.230055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc8ec-02c3-4918-93a1-70efa4b52295 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:12.230458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fc8ec-02c3-4918-93a1-70efa4b52295 None admin] PATH_INFO: `/v3/services` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:12.231395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fc8ec-02c3-4918-93a1-70efa4b52295 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:12.231829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fc8ec-02c3-4918-93a1-70efa4b52295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:12.233784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706fc8ec-02c3-4918-93a1-70efa4b52295 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:12.240674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 644/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 01:11:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:14.195065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b31e3-42c5-4dba-ba50-2b3277eb520c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:14.195687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b31e3-42c5-4dba-ba50-2b3277eb520c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:14.195687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b31e3-42c5-4dba-ba50-2b3277eb520c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:14.197008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 649/1293] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:11:14.203289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5df7-903e-4f23-b9b4-3cb09d6ae09c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:14.204046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5df7-903e-4f23-b9b4-3cb09d6ae09c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:14.204197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb5df7-903e-4f23-b9b4-3cb09d6ae09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:14.229374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8adb5df7-903e-4f23-b9b4-3cb09d6ae09c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:11:14.230611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8adb5df7-903e-4f23-b9b4-3cb09d6ae09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:11:14.266651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:14.306590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 645/1294] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:11:14.328907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b31e3-42c5-4dba-ba50-2b3277eb520c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:14.369169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:14.444054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b31e3-42c5-4dba-ba50-2b3277eb520c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:14.479100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cb3c8-8703-4e9a-8afb-8a48f1866c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:14.479646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cb3c8-8703-4e9a-8afb-8a48f1866c89 None admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:14.479929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cb3c8-8703-4e9a-8afb-8a48f1866c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:14.480193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cb3c8-8703-4e9a-8afb-8a48f1866c89 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:14.480884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cb3c8-8703-4e9a-8afb-8a48f1866c89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:14.482292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cb3c8-8703-4e9a-8afb-8a48f1866c89 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:14.499093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 650/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Sat Aug 6 01:11:14 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:11:16.482599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9247-41e6-4b6e-ad0b-fc4e360bf23a None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:16.483184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9247-41e6-4b6e-ad0b-fc4e360bf23a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:16.483184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f9247-41e6-4b6e-ad0b-fc4e360bf23a None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:16.485268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 646/1296] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:11:16.494002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9b3c-df9b-4634-9b08-658ee20de9e7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:16.494718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9b3c-df9b-4634-9b08-658ee20de9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:16.494883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f9b3c-df9b-4634-9b08-658ee20de9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:16.516121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-630f9b3c-df9b-4634-9b08-658ee20de9e7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:11:16.517323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-630f9b3c-df9b-4634-9b08-658ee20de9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:11:16.593642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 651/1297] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:11:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:11:16.629906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9247-41e6-4b6e-ad0b-fc4e360bf23a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:16.749740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f9247-41e6-4b6e-ad0b-fc4e360bf23a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:16.786897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:16.787536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:16.787834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:16.788093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:16.788721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:16.790170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:16.798957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:16.800313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:16.801441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 647/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:11:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:16.806343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f9b3c-df9b-4634-9b08-658ee20de9e7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:16.825403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:16.912061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f9b3c-df9b-4634-9b08-658ee20de9e7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:16.950236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:16.950850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:16.951130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:16.951399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:16.952074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:16.952381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:16.953755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:16.959146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 652/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 01:11:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:16.965340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:17.000837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:17.071093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398a823-393f-4077-80f9-c6c89ea9b371 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:17.105764 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7876f-1a10-4db0-95fe-18b016731b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:17.106412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7876f-1a10-4db0-95fe-18b016731b68 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:17.106691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7876f-1a10-4db0-95fe-18b016731b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:17.106964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7876f-1a10-4db0-95fe-18b016731b68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:17.107721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7876f-1a10-4db0-95fe-18b016731b68 None admin] RBAC: Adding query filter params (interface=public, service_id=b9f99096a5b242308c53b9524e0b6b1b, region_id=RegionOne) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:17.108036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7876f-1a10-4db0-95fe-18b016731b68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:17.109420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7876f-1a10-4db0-95fe-18b016731b68 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:17.114619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 648/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Sat Aug 6 01:11:16 2022] GET /identity/v3/endpoints?service_id=b9f99096a5b242308c53b9524e0b6b1b&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:17.121133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:17.209871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:17.230913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574ff3b-2234-4305-8b82-aacce80487cb None admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:17.270778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba7678-a929-45fa-86c2-ad03b5775964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:17.271407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7678-a929-45fa-86c2-ad03b5775964 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:17.271719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7678-a929-45fa-86c2-ad03b5775964 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:17.272031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba7678-a929-45fa-86c2-ad03b5775964 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:17.272779 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba7678-a929-45fa-86c2-ad03b5775964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:17.274796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba7678-a929-45fa-86c2-ad03b5775964 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:17.282589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 653/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Sat Aug 6 01:11:17 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:11:19.237995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dd1ca-82ff-4290-b05c-4c0e633ece88 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:19.238856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dd1ca-82ff-4290-b05c-4c0e633ece88 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:19.238856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dd1ca-82ff-4290-b05c-4c0e633ece88 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:19.241123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 649/1302] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:11:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:11:19.247343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7b414-3ae2-4596-bd91-e4248ac6a0bc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:19.247758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7b414-3ae2-4596-bd91-e4248ac6a0bc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:19.247896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7b414-3ae2-4596-bd91-e4248ac6a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:19.274339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-45f7b414-3ae2-4596-bd91-e4248ac6a0bc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:11:19.275542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-45f7b414-3ae2-4596-bd91-e4248ac6a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:11:19.350313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 654/1303] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:11:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 06 01:11:19.372512 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dd1ca-82ff-4290-b05c-4c0e633ece88 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:19.473117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:19.480608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dd1ca-82ff-4290-b05c-4c0e633ece88 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:19.518247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:19.518902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:19.519184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:19.519461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:19.520095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:19.521513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 06 01:11:19.530826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 06 01:11:19.531974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.get_or_create( Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application with Lock( Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self._enter() Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application return self.creator() Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application created_value = creator( Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: ERROR keystone.server.flask.application Aug 06 01:11:19.533019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 650/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Sat Aug 6 01:11:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 06 01:11:19.538219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7b414-3ae2-4596-bd91-e4248ac6a0bc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:19.621765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:19.646278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7b414-3ae2-4596-bd91-e4248ac6a0bc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:19.681959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9b9e3-175a-4ad9-801e-2850fca6a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:19.682592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b9e3-175a-4ad9-801e-2850fca6a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:19.682868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b9e3-175a-4ad9-801e-2850fca6a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:19.683142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9b9e3-175a-4ad9-801e-2850fca6a7e1 None admin] PATH_INFO: `/v3/services` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:19.683816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b9e3-175a-4ad9-801e-2850fca6a7e1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:11:19.684133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b9e3-175a-4ad9-801e-2850fca6a7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:19.685504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9b9e3-175a-4ad9-801e-2850fca6a7e1 None admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:19.691102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 655/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Sat Aug 6 01:11:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:11:19.697161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:11:19.798441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782381-bca6-4b13-8eaf-f85947459c55 None admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:11:19.833883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2de2-daa2-49ed-b14c-2d6208252b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:11:19.834520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2de2-daa2-49ed-b14c-2d6208252b87 None admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:11:19.834799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2de2-daa2-49ed-b14c-2d6208252b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:11:19.835074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2de2-daa2-49ed-b14c-2d6208252b87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:11:19.835777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2de2-daa2-49ed-b14c-2d6208252b87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:11:19.837170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2de2-daa2-49ed-b14c-2d6208252b87 None admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:11:19.866195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 651/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:11:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:11:29.688003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=30 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:11:29.862048 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:22.509361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d013-67c9-4736-9db9-2757431b6dfd None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:22.509869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d013-67c9-4736-9db9-2757431b6dfd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:22.510002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40d013-67c9-4736-9db9-2757431b6dfd None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:22.511511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 656/1307] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:22.519817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fa936-b01a-41ef-9299-fc9a78e468e6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:22.520639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fa936-b01a-41ef-9299-fc9a78e468e6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:22.520737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fa936-b01a-41ef-9299-fc9a78e468e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:22.668912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e35fa936-b01a-41ef-9299-fc9a78e468e6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:22.670078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e35fa936-b01a-41ef-9299-fc9a78e468e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:22.898034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 652/1308] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:12:22.944736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957cf22-1e9b-453b-84c7-a06e8b95a7ed None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:22.945275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957cf22-1e9b-453b-84c7-a06e8b95a7ed None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:22.945800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957cf22-1e9b-453b-84c7-a06e8b95a7ed None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:22.948177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 657/1309] 10.222.0.17 () {54 vars in 965 bytes} [Sat Aug 6 01:12:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:22.959813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89af37-c98d-46a5-94fd-0c048d3638fe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:22.960031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89af37-c98d-46a5-94fd-0c048d3638fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:22.960298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89af37-c98d-46a5-94fd-0c048d3638fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:23.096884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4b89af37-c98d-46a5-94fd-0c048d3638fe None None] MFA Rules not processed for user `ed70b6997f064f3f8fa68dea2a6eb470`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:23.098180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4b89af37-c98d-46a5-94fd-0c048d3638fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:23.121712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:23.182704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 653/1310] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Aug 6 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 06 01:12:23.192641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957cf22-1e9b-453b-84c7-a06e8b95a7ed None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:23.194755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2957cf22-1e9b-453b-84c7-a06e8b95a7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:23.336967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957cf22-1e9b-453b-84c7-a06e8b95a7ed None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:23.420470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4016b93-721c-489e-b1aa-43aaebcddea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:23.421269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4016b93-721c-489e-b1aa-43aaebcddea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:23.421723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4016b93-721c-489e-b1aa-43aaebcddea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:23.422097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4016b93-721c-489e-b1aa-43aaebcddea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:23.423806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e4016b93-721c-489e-b1aa-43aaebcddea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:23.481148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:23.548159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4016b93-721c-489e-b1aa-43aaebcddea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:23.549644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4016b93-721c-489e-b1aa-43aaebcddea5 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:23.568791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 658/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:25.856426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d105c-3ec5-42a6-b8ae-e096544d4be8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:25.856954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d105c-3ec5-42a6-b8ae-e096544d4be8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:25.856954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d105c-3ec5-42a6-b8ae-e096544d4be8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:25.858518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 654/1312] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:25.864086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0099-51d8-4c55-9093-400b77c36c09 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:25.864555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0099-51d8-4c55-9093-400b77c36c09 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:25.864655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b0099-51d8-4c55-9093-400b77c36c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:25.954907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fc4b0099-51d8-4c55-9093-400b77c36c09 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:25.956160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fc4b0099-51d8-4c55-9093-400b77c36c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:26.061500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 659/1313] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:26.099748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d105c-3ec5-42a6-b8ae-e096544d4be8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:26.101315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c2d105c-3ec5-42a6-b8ae-e096544d4be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:26.220036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d105c-3ec5-42a6-b8ae-e096544d4be8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:26.298249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:26.301284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767a43b-efff-45e3-a5ec-0b7f0c3b54b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:26.301952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a43b-efff-45e3-a5ec-0b7f0c3b54b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:26.302235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a43b-efff-45e3-a5ec-0b7f0c3b54b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:26.302516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767a43b-efff-45e3-a5ec-0b7f0c3b54b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:26.304671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7767a43b-efff-45e3-a5ec-0b7f0c3b54b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:26.418445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a43b-efff-45e3-a5ec-0b7f0c3b54b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:26.419954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767a43b-efff-45e3-a5ec-0b7f0c3b54b1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:26.440043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 655/1314] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:28.719260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9b6d3-7575-4b05-b71f-a7e605954dbe None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:28.719260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9b6d3-7575-4b05-b71f-a7e605954dbe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:28.720040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9b6d3-7575-4b05-b71f-a7e605954dbe None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:28.720869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 660/1315] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:28.727401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1aef1-d631-49fe-a460-fbf515c33945 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:28.728142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1aef1-d631-49fe-a460-fbf515c33945 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:28.728239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1aef1-d631-49fe-a460-fbf515c33945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:28.801993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-53d1aef1-d631-49fe-a460-fbf515c33945 None None] MFA Rules not processed for user `8fd98010f65d42aeb277ffa7a796efbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:28.803163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-53d1aef1-d631-49fe-a460-fbf515c33945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:28.861590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:28.910424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 656/1316] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:28.964251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf8fa-41fe-4f56-a96a-5464bb5cadd1 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:28.964484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf8fa-41fe-4f56-a96a-5464bb5cadd1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:28.964788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbf8fa-41fe-4f56-a96a-5464bb5cadd1 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:28.966208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 661/1317] 10.222.0.17 () {54 vars in 965 bytes} [Sat Aug 6 01:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:28.972719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3239-ea8b-4146-b71c-993327c37066 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:28.973113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3239-ea8b-4146-b71c-993327c37066 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:28.973502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d3239-ea8b-4146-b71c-993327c37066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:29.055866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a06d3239-ea8b-4146-b71c-993327c37066 None None] MFA Rules not processed for user `ed70b6997f064f3f8fa68dea2a6eb470`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:29.056974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a06d3239-ea8b-4146-b71c-993327c37066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:29.134311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 657/1318] 10.222.0.17 () {58 vars in 1062 bytes} [Sat Aug 6 01:12:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:29.144137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbf8fa-41fe-4f56-a96a-5464bb5cadd1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:29.146991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a8fbf8fa-41fe-4f56-a96a-5464bb5cadd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:29.160338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:29.268421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbf8fa-41fe-4f56-a96a-5464bb5cadd1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:29.342467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f2d63-d949-49f0-9ab8-a116554c17f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:29.343015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2d63-d949-49f0-9ab8-a116554c17f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:29.343290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2d63-d949-49f0-9ab8-a116554c17f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:29.343614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f2d63-d949-49f0-9ab8-a116554c17f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:29.345227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6d8f2d63-d949-49f0-9ab8-a116554c17f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:29.410283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:29.459309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f2d63-d949-49f0-9ab8-a116554c17f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:29.461543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f2d63-d949-49f0-9ab8-a116554c17f9 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:29.489067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 662/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:32.400351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4554cc-5900-491b-a45d-4ddfe579baf7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:32.400947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4554cc-5900-491b-a45d-4ddfe579baf7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:32.400947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4554cc-5900-491b-a45d-4ddfe579baf7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:32.403098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 658/1320] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:32.409819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1c7c-8035-4282-983a-4b0978848049 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:32.410294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1c7c-8035-4282-983a-4b0978848049 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:32.410386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de1c7c-8035-4282-983a-4b0978848049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:32.478322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-28de1c7c-8035-4282-983a-4b0978848049 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:32.479562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-28de1c7c-8035-4282-983a-4b0978848049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:32.581152 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 663/1321] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:12:32.620390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4554cc-5900-491b-a45d-4ddfe579baf7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:32.621970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ad4554cc-5900-491b-a45d-4ddfe579baf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:32.673989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:32.728365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4554cc-5900-491b-a45d-4ddfe579baf7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:32.803741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47066f72-a608-4ebe-a4f3-4748fb0b466e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:32.804367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47066f72-a608-4ebe-a4f3-4748fb0b466e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:32.804650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47066f72-a608-4ebe-a4f3-4748fb0b466e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:32.804925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47066f72-a608-4ebe-a4f3-4748fb0b466e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:32.806586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47066f72-a608-4ebe-a4f3-4748fb0b466e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:32.913871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:32.935392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47066f72-a608-4ebe-a4f3-4748fb0b466e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:32.937435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47066f72-a608-4ebe-a4f3-4748fb0b466e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:32.956908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 659/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:35.667296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485037-50bc-4f94-9850-bbf6f6276ce2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:35.667847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485037-50bc-4f94-9850-bbf6f6276ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:35.667847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c485037-50bc-4f94-9850-bbf6f6276ce2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:35.669383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 664/1323] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:35.674648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca2e9b-7a49-439d-af3d-0249a7809a01 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:35.675107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca2e9b-7a49-439d-af3d-0249a7809a01 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:35.675214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca2e9b-7a49-439d-af3d-0249a7809a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:35.741177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4eca2e9b-7a49-439d-af3d-0249a7809a01 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:35.742403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4eca2e9b-7a49-439d-af3d-0249a7809a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:35.850545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 660/1324] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:35.886883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c485037-50bc-4f94-9850-bbf6f6276ce2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:35.888424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3c485037-50bc-4f94-9850-bbf6f6276ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:35.911366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:35.998710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c485037-50bc-4f94-9850-bbf6f6276ce2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:36.073668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce2d0f3-93d9-458f-9a47-80407f593adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:36.074331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d0f3-93d9-458f-9a47-80407f593adc service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:36.074607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d0f3-93d9-458f-9a47-80407f593adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:36.074877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce2d0f3-93d9-458f-9a47-80407f593adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:36.076499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0ce2d0f3-93d9-458f-9a47-80407f593adc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:36.147764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:36.186685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2d0f3-93d9-458f-9a47-80407f593adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:36.188200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce2d0f3-93d9-458f-9a47-80407f593adc service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:36.207714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 665/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:38.249835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d5bb-230f-48ef-af69-a7011d4a4bb1 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:38.250401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d5bb-230f-48ef-af69-a7011d4a4bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:38.250401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580d5bb-230f-48ef-af69-a7011d4a4bb1 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:38.251658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 661/1326] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:38.257060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de04d7-0095-490d-bf05-56de2a65efb6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:38.257468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de04d7-0095-490d-bf05-56de2a65efb6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:38.257617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de04d7-0095-490d-bf05-56de2a65efb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:38.329721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-09de04d7-0095-490d-bf05-56de2a65efb6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:38.330959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-09de04d7-0095-490d-bf05-56de2a65efb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:38.429716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 666/1327] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:38.466042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d5bb-230f-48ef-af69-a7011d4a4bb1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:38.467809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2580d5bb-230f-48ef-af69-a7011d4a4bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:38.531853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:38.577288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580d5bb-230f-48ef-af69-a7011d4a4bb1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:38.659026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29ccbb-3c06-4a56-aaa1-f4f2c09095c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:38.659657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29ccbb-3c06-4a56-aaa1-f4f2c09095c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:38.659938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29ccbb-3c06-4a56-aaa1-f4f2c09095c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:38.660212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29ccbb-3c06-4a56-aaa1-f4f2c09095c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:38.661841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b29ccbb-3c06-4a56-aaa1-f4f2c09095c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:38.771942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:38.774213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29ccbb-3c06-4a56-aaa1-f4f2c09095c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:38.776022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29ccbb-3c06-4a56-aaa1-f4f2c09095c9 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:38.794745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 662/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:40.836355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a18b-1388-43e0-8395-be67ea843383 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:40.836916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a18b-1388-43e0-8395-be67ea843383 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:40.836916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a18b-1388-43e0-8395-be67ea843383 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:40.838244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 667/1329] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:40.843619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4b3fa-f293-4e96-849d-c5d5ae78b185 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:40.844067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4b3fa-f293-4e96-849d-c5d5ae78b185 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:40.844147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4b3fa-f293-4e96-849d-c5d5ae78b185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:40.914065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b9f4b3fa-f293-4e96-849d-c5d5ae78b185 None None] MFA Rules not processed for user `8fd98010f65d42aeb277ffa7a796efbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:40.915306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9f4b3fa-f293-4e96-849d-c5d5ae78b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:41.015719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 663/1330] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:12:41.054266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a18b-1388-43e0-8395-be67ea843383 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:41.055944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f335a18b-1388-43e0-8395-be67ea843383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:41.088628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:41.165344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a18b-1388-43e0-8395-be67ea843383 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:41.243794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80725397-7f3d-46e8-a393-89f29dd2959e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:41.244435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725397-7f3d-46e8-a393-89f29dd2959e service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:41.244711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725397-7f3d-46e8-a393-89f29dd2959e service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:41.245016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80725397-7f3d-46e8-a393-89f29dd2959e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:41.246719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-80725397-7f3d-46e8-a393-89f29dd2959e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:41.326003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:41.358793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80725397-7f3d-46e8-a393-89f29dd2959e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:41.360165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80725397-7f3d-46e8-a393-89f29dd2959e service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:41.380005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 668/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:43.625739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9e12-8d2b-47d9-b7a2-f0926b5d65f4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:43.626362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9e12-8d2b-47d9-b7a2-f0926b5d65f4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:43.626362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d9e12-8d2b-47d9-b7a2-f0926b5d65f4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:43.627714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 664/1332] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:43.634254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a00e3-8952-498a-854f-93b494ae871f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:43.634949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a00e3-8952-498a-854f-93b494ae871f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:43.635148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a00e3-8952-498a-854f-93b494ae871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:43.706170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-de3a00e3-8952-498a-854f-93b494ae871f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:43.707363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-de3a00e3-8952-498a-854f-93b494ae871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:43.809593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 669/1333] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:43.845979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d9e12-8d2b-47d9-b7a2-f0926b5d65f4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:43.847572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-052d9e12-8d2b-47d9-b7a2-f0926b5d65f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:43.921728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:43.959759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d9e12-8d2b-47d9-b7a2-f0926b5d65f4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:44.048954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc797e0-caa2-467f-9704-e70f45036035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:44.049541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc797e0-caa2-467f-9704-e70f45036035 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:44.049854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc797e0-caa2-467f-9704-e70f45036035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:44.050161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc797e0-caa2-467f-9704-e70f45036035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:44.051779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9dc797e0-caa2-467f-9704-e70f45036035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:44.164016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc797e0-caa2-467f-9704-e70f45036035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:44.165403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc797e0-caa2-467f-9704-e70f45036035 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:44.175669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:44.184326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 665/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:46.251709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018906cc-d8ec-4748-ad29-715140f19962 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:46.252651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018906cc-d8ec-4748-ad29-715140f19962 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:46.252651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018906cc-d8ec-4748-ad29-715140f19962 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:46.254876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 670/1335] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:46.261158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dd326-1b05-4d80-b35b-71a4a42d63f8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:46.261974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dd326-1b05-4d80-b35b-71a4a42d63f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:46.262144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dd326-1b05-4d80-b35b-71a4a42d63f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:46.337330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-df8dd326-1b05-4d80-b35b-71a4a42d63f8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:46.338604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df8dd326-1b05-4d80-b35b-71a4a42d63f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:46.445785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 666/1336] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:46.487357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018906cc-d8ec-4748-ad29-715140f19962 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:46.489754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-018906cc-d8ec-4748-ad29-715140f19962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:46.536325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:46.601575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018906cc-d8ec-4748-ad29-715140f19962 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:46.678335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933c197-19a8-4150-8ea6-8d9aa3447002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:46.678952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c197-19a8-4150-8ea6-8d9aa3447002 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:46.679224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c197-19a8-4150-8ea6-8d9aa3447002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:46.679503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933c197-19a8-4150-8ea6-8d9aa3447002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:46.681129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3933c197-19a8-4150-8ea6-8d9aa3447002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:46.775470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:46.803145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933c197-19a8-4150-8ea6-8d9aa3447002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:46.804629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933c197-19a8-4150-8ea6-8d9aa3447002 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:46.823058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 671/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:49.154354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec852ae-116e-4ff6-929d-1947b7a3decf None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:49.154951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec852ae-116e-4ff6-929d-1947b7a3decf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:49.154951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec852ae-116e-4ff6-929d-1947b7a3decf None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:49.156263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 667/1338] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:49.161616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f91f-c256-4cf1-9df1-5cb064f9a87e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:49.162077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f91f-c256-4cf1-9df1-5cb064f9a87e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:49.162182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f91f-c256-4cf1-9df1-5cb064f9a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:49.230736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3bd2f91f-c256-4cf1-9df1-5cb064f9a87e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:49.231976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3bd2f91f-c256-4cf1-9df1-5cb064f9a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:49.333401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 672/1339] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:49.383107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec852ae-116e-4ff6-929d-1947b7a3decf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:49.385498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8ec852ae-116e-4ff6-929d-1947b7a3decf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:49.476251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:49.506070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec852ae-116e-4ff6-929d-1947b7a3decf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:49.582802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426c38e-23ab-4fcf-9da7-95158d75a219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:49.583438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c38e-23ab-4fcf-9da7-95158d75a219 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:49.583721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c38e-23ab-4fcf-9da7-95158d75a219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:49.583999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426c38e-23ab-4fcf-9da7-95158d75a219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:49.585631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5426c38e-23ab-4fcf-9da7-95158d75a219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:49.707612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426c38e-23ab-4fcf-9da7-95158d75a219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:49.709125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426c38e-23ab-4fcf-9da7-95158d75a219 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:49.728127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 668/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:53.636806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016a083-97e9-4880-a95c-00f996ffe0ca None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:53.637391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016a083-97e9-4880-a95c-00f996ffe0ca None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:53.637391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016a083-97e9-4880-a95c-00f996ffe0ca None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:53.638764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 673/1341] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:53.644602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7414-e5b5-4c14-8370-98739d305194 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:53.645057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7414-e5b5-4c14-8370-98739d305194 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:53.645160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7414-e5b5-4c14-8370-98739d305194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:53.650957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:53.717203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cdad7414-e5b5-4c14-8370-98739d305194 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:53.718501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cdad7414-e5b5-4c14-8370-98739d305194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:53.818905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 669/1342] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:53.857390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016a083-97e9-4880-a95c-00f996ffe0ca None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:53.859107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b016a083-97e9-4880-a95c-00f996ffe0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:53.911129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:53.969393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016a083-97e9-4880-a95c-00f996ffe0ca None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:54.046892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94850e-2fd4-40e5-92cb-31d04af8bcc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:54.047526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94850e-2fd4-40e5-92cb-31d04af8bcc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:54.047800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94850e-2fd4-40e5-92cb-31d04af8bcc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:54.048064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94850e-2fd4-40e5-92cb-31d04af8bcc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:54.049687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1e94850e-2fd4-40e5-92cb-31d04af8bcc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:54.141708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:54.161799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94850e-2fd4-40e5-92cb-31d04af8bcc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:54.163269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e94850e-2fd4-40e5-92cb-31d04af8bcc1 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:54.181716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 674/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:12:56.829735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e5fc-254f-48d3-a284-c611d1f653d7 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:56.830321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e5fc-254f-48d3-a284-c611d1f653d7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:56.830321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720e5fc-254f-48d3-a284-c611d1f653d7 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:56.831638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 670/1344] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:12:56.837462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcc835-3481-4b58-94f3-21df70d5277b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:56.838018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcc835-3481-4b58-94f3-21df70d5277b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:56.838018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcc835-3481-4b58-94f3-21df70d5277b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:56.910528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a9fcc835-3481-4b58-94f3-21df70d5277b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:12:56.911792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a9fcc835-3481-4b58-94f3-21df70d5277b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:57.016377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 675/1345] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:12:57.054682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720e5fc-254f-48d3-a284-c611d1f653d7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:12:57.056280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0720e5fc-254f-48d3-a284-c611d1f653d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:57.150875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:12:57.169970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720e5fc-254f-48d3-a284-c611d1f653d7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:12:57.256078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93832d2-207f-4b15-85d5-51a92398fcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:12:57.256725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93832d2-207f-4b15-85d5-51a92398fcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:12:57.257004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93832d2-207f-4b15-85d5-51a92398fcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:12:57.257275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93832d2-207f-4b15-85d5-51a92398fcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:12:57.258978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a93832d2-207f-4b15-85d5-51a92398fcd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:12:57.374039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93832d2-207f-4b15-85d5-51a92398fcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:12:57.375610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93832d2-207f-4b15-85d5-51a92398fcd6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:12:57.394924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 671/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:12:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:01.730927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d91de-502a-49f5-b662-81538cf78236 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:01.731425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d91de-502a-49f5-b662-81538cf78236 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:01.731519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d91de-502a-49f5-b662-81538cf78236 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:01.732885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 676/1347] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:01.738678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a8fe-afee-4a9a-8bc2-16d385814cfc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:01.739241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a8fe-afee-4a9a-8bc2-16d385814cfc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:01.739241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a8fe-afee-4a9a-8bc2-16d385814cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:01.756171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:01.813026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e739a8fe-afee-4a9a-8bc2-16d385814cfc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:01.814376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e739a8fe-afee-4a9a-8bc2-16d385814cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:01.929245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 672/1348] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:01.967387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d91de-502a-49f5-b662-81538cf78236 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:01.969167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-553d91de-502a-49f5-b662-81538cf78236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:02.029681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:02.084591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d91de-502a-49f5-b662-81538cf78236 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:02.161658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8aac3-fdbc-401f-a9b6-fb450cd17126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:02.162437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8aac3-fdbc-401f-a9b6-fb450cd17126 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:02.162550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8aac3-fdbc-401f-a9b6-fb450cd17126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:02.162854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8aac3-fdbc-401f-a9b6-fb450cd17126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:02.164494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-02b8aac3-fdbc-401f-a9b6-fb450cd17126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:02.276404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:02.280238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8aac3-fdbc-401f-a9b6-fb450cd17126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:02.281777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8aac3-fdbc-401f-a9b6-fb450cd17126 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:02.302273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 677/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:07.145912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1576-ecfd-46fa-a34e-3e8fd78fde49 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:07.147209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1576-ecfd-46fa-a34e-3e8fd78fde49 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:07.147209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae1576-ecfd-46fa-a34e-3e8fd78fde49 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:07.148814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 673/1350] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:13:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:07.163585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f14b-6bb5-4039-8f1e-72c4de58be8d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:07.164033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f14b-6bb5-4039-8f1e-72c4de58be8d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:07.164147 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f14b-6bb5-4039-8f1e-72c4de58be8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:07.275350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6489f14b-6bb5-4039-8f1e-72c4de58be8d None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:07.276796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6489f14b-6bb5-4039-8f1e-72c4de58be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:07.412324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 678/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:11.408530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86306a-1e3c-42d7-a559-91ad622bdc3b None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:11.409098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86306a-1e3c-42d7-a559-91ad622bdc3b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:11.409098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86306a-1e3c-42d7-a559-91ad622bdc3b None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:11.410589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 674/1352] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:11.415860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f7ef6-f012-4762-9a9f-ad657ccfae1e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:11.416763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f7ef6-f012-4762-9a9f-ad657ccfae1e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:11.417289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f7ef6-f012-4762-9a9f-ad657ccfae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:11.478484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:11.507505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-301f7ef6-f012-4762-9a9f-ad657ccfae1e None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:11.508808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-301f7ef6-f012-4762-9a9f-ad657ccfae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:11.620067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 679/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:11.927427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=59 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:12.961220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623c49-ff2a-48c1-9386-1d00b6af2018 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:12.961991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623c49-ff2a-48c1-9386-1d00b6af2018 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:12.961991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02623c49-ff2a-48c1-9386-1d00b6af2018 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:12.963190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 675/1354] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:12.968490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37cd5-b94c-471c-a80b-cee96cf440a0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:12.968885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37cd5-b94c-471c-a80b-cee96cf440a0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:12.969076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff37cd5-b94c-471c-a80b-cee96cf440a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:13.188589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9ff37cd5-b94c-471c-a80b-cee96cf440a0 None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:13.190153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9ff37cd5-b94c-471c-a80b-cee96cf440a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:13.237556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:13.308073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 680/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:16.584243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb14e-afa2-4b69-be76-3d6bcfa9d26e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:16.584804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb14e-afa2-4b69-be76-3d6bcfa9d26e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:16.584804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb14e-afa2-4b69-be76-3d6bcfa9d26e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:16.589545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 676/1356] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:16.591587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a931-a452-4135-a167-97b1d59a7a1e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:16.592036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a931-a452-4135-a167-97b1d59a7a1e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:16.592142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a931-a452-4135-a167-97b1d59a7a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:16.670567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f880a931-a452-4135-a167-97b1d59a7a1e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:16.672020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f880a931-a452-4135-a167-97b1d59a7a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:16.778533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 681/1357] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:16.832976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8bf7-e999-4b36-9125-e7288663196e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:16.833607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8bf7-e999-4b36-9125-e7288663196e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:16.834216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f8bf7-e999-4b36-9125-e7288663196e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:16.835938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 677/1358] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 01:13:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:16.843573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64554e-9bca-4da8-8965-d5ac85e562e7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:16.843862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64554e-9bca-4da8-8965-d5ac85e562e7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:16.844152 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64554e-9bca-4da8-8965-d5ac85e562e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:16.865134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:16.935689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8a64554e-9bca-4da8-8965-d5ac85e562e7 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:16.937243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8a64554e-9bca-4da8-8965-d5ac85e562e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:17.058559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 682/1359] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 01:13:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:17.066550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8bf7-e999-4b36-9125-e7288663196e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:17.068331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eb4f8bf7-e999-4b36-9125-e7288663196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:17.220500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f8bf7-e999-4b36-9125-e7288663196e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:17.303490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:17.345055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5859d-1572-445c-87e5-60c8857973a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:17.345596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5859d-1572-445c-87e5-60c8857973a0 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:17.345878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5859d-1572-445c-87e5-60c8857973a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:17.346186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5859d-1572-445c-87e5-60c8857973a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:17.347803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-51a5859d-1572-445c-87e5-60c8857973a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:17.442161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5859d-1572-445c-87e5-60c8857973a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:17.444354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5859d-1572-445c-87e5-60c8857973a0 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:17.464238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 678/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:13:19.651622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfdeae-0408-4a2b-b3f7-f7ead2aab4cf None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:19.652165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfdeae-0408-4a2b-b3f7-f7ead2aab4cf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:19.652261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfdeae-0408-4a2b-b3f7-f7ead2aab4cf None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:19.654001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 683/1361] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:19.659457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e82c3-4da1-4fc4-aefc-a9b76bceb233 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:19.659867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e82c3-4da1-4fc4-aefc-a9b76bceb233 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:19.660044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e82c3-4da1-4fc4-aefc-a9b76bceb233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:19.734949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fd0e82c3-4da1-4fc4-aefc-a9b76bceb233 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:19.736114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fd0e82c3-4da1-4fc4-aefc-a9b76bceb233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:19.776349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:19.843661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 679/1362] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:19.890359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfdeae-0408-4a2b-b3f7-f7ead2aab4cf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:19.893242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a9dfdeae-0408-4a2b-b3f7-f7ead2aab4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:19.974616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:20.076143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfdeae-0408-4a2b-b3f7-f7ead2aab4cf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:20.227798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39909865-2b10-4441-92fb-dcc0f21b85cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:20.228456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909865-2b10-4441-92fb-dcc0f21b85cf service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:20.228730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909865-2b10-4441-92fb-dcc0f21b85cf service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:20.228991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39909865-2b10-4441-92fb-dcc0f21b85cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:20.230600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-39909865-2b10-4441-92fb-dcc0f21b85cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:20.255302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:20.326488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909865-2b10-4441-92fb-dcc0f21b85cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:20.328301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39909865-2b10-4441-92fb-dcc0f21b85cf service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:20.347191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 684/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:22.690816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacc28-491a-408e-87f4-a39625af538d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:22.691412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacc28-491a-408e-87f4-a39625af538d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:22.691412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dacc28-491a-408e-87f4-a39625af538d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:22.694245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 680/1364] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:22.698608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a5c44-7ded-4075-b320-163e0fd89949 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:22.699083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a5c44-7ded-4075-b320-163e0fd89949 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:22.699165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a5c44-7ded-4075-b320-163e0fd89949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:22.784092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-bf6a5c44-7ded-4075-b320-163e0fd89949 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:22.785227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bf6a5c44-7ded-4075-b320-163e0fd89949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:22.890616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:22.901977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 685/1365] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:22.940814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ffef-a908-449e-bada-964867cf88fc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:22.941236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ffef-a908-449e-bada-964867cf88fc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:22.941614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9ffef-a908-449e-bada-964867cf88fc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:22.943307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 681/1366] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 01:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:22.948892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439cf4-b5bc-425d-b579-6ab63e596c4d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:22.949304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439cf4-b5bc-425d-b579-6ab63e596c4d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:22.949669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439cf4-b5bc-425d-b579-6ab63e596c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:23.033014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f4439cf4-b5bc-425d-b579-6ab63e596c4d None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:23.033979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f4439cf4-b5bc-425d-b579-6ab63e596c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:23.170574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 686/1367] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:23.182622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ffef-a908-449e-bada-964867cf88fc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:23.184286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9e9ffef-a908-449e-bada-964867cf88fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:23.346099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9ffef-a908-449e-bada-964867cf88fc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:23.367385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:23.469873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a03a6-66ab-421c-a0c0-5b985235e011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:23.470533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a03a6-66ab-421c-a0c0-5b985235e011 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:23.470791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a03a6-66ab-421c-a0c0-5b985235e011 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:23.471082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a03a6-66ab-421c-a0c0-5b985235e011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:23.472746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cd6a03a6-66ab-421c-a0c0-5b985235e011 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:23.576166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a03a6-66ab-421c-a0c0-5b985235e011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:23.577981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a03a6-66ab-421c-a0c0-5b985235e011 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:23.597148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 682/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:24.546280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896331d9-69f3-47ff-b426-a1b0c7dfd68f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:24.546811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896331d9-69f3-47ff-b426-a1b0c7dfd68f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:24.546919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896331d9-69f3-47ff-b426-a1b0c7dfd68f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:24.553821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 687/1369] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:24.561758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8f6a8-bdcc-428b-83c5-d404f8f03bd1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:24.562661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8f6a8-bdcc-428b-83c5-d404f8f03bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:24.563142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8f6a8-bdcc-428b-83c5-d404f8f03bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:24.599113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:24.637588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-63f8f6a8-bdcc-428b-83c5-d404f8f03bd1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:24.639116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-63f8f6a8-bdcc-428b-83c5-d404f8f03bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:24.749959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 683/1370] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:25.088057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5d286-16cd-4953-9ce4-10d92da6c04c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:25.088344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5d286-16cd-4953-9ce4-10d92da6c04c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:25.088548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5d286-16cd-4953-9ce4-10d92da6c04c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:25.090265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 688/1371] 10.222.0.17 () {54 vars in 964 bytes} [Sat Aug 6 01:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:25.095266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e54c-f61e-4ecb-aa46-a440b4f310c0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:25.095649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e54c-f61e-4ecb-aa46-a440b4f310c0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:25.096017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e54c-f61e-4ecb-aa46-a440b4f310c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:25.175055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2f73e54c-f61e-4ecb-aa46-a440b4f310c0 None None] MFA Rules not processed for user `b52057428b6444fbbb5d182ab8a2c80a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:25.176412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2f73e54c-f61e-4ecb-aa46-a440b4f310c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:25.227697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:25.261917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 684/1372] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Aug 6 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:25.270462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5d286-16cd-4953-9ce4-10d92da6c04c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:25.274224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-64c5d286-16cd-4953-9ce4-10d92da6c04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:25.332351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:25.389882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5d286-16cd-4953-9ce4-10d92da6c04c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:25.469797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96ecb14-5e1d-4650-ad74-0b34d1f3dd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:25.470609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ecb14-5e1d-4650-ad74-0b34d1f3dd4b service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:25.470982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ecb14-5e1d-4650-ad74-0b34d1f3dd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:25.471371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96ecb14-5e1d-4650-ad74-0b34d1f3dd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:25.473104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c96ecb14-5e1d-4650-ad74-0b34d1f3dd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:25.574669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:25.588629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ecb14-5e1d-4650-ad74-0b34d1f3dd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:25.590272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96ecb14-5e1d-4650-ad74-0b34d1f3dd4b service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:25.610695 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 689/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:25.683453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa10e-cde0-4b24-bfe9-3defdc347ead None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:25.684061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa10e-cde0-4b24-bfe9-3defdc347ead None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:25.684061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387aa10e-cde0-4b24-bfe9-3defdc347ead None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:25.685499 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 685/1374] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:25.690900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff118dc-c7fb-4183-8822-8f1ef5eeb76d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:25.691185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff118dc-c7fb-4183-8822-8f1ef5eeb76d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:25.691462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff118dc-c7fb-4183-8822-8f1ef5eeb76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:25.760860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0ff118dc-c7fb-4183-8822-8f1ef5eeb76d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:25.762251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0ff118dc-c7fb-4183-8822-8f1ef5eeb76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:25.882442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 690/1375] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:25.923409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aa10e-cde0-4b24-bfe9-3defdc347ead None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:25.925810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-387aa10e-cde0-4b24-bfe9-3defdc347ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:26.105547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387aa10e-cde0-4b24-bfe9-3defdc347ead None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:26.158196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:26.223119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31cc8c-9e21-452f-98e6-7705a3b6362a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:26.223747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31cc8c-9e21-452f-98e6-7705a3b6362a service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:26.224025 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31cc8c-9e21-452f-98e6-7705a3b6362a service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:26.224295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31cc8c-9e21-452f-98e6-7705a3b6362a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:26.225958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ab31cc8c-9e21-452f-98e6-7705a3b6362a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:26.319146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31cc8c-9e21-452f-98e6-7705a3b6362a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:26.320785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31cc8c-9e21-452f-98e6-7705a3b6362a service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:26.340328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 686/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:28.375081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d24459-c4fe-4387-b12c-98e1f51d3404 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:28.375600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d24459-c4fe-4387-b12c-98e1f51d3404 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:28.375600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d24459-c4fe-4387-b12c-98e1f51d3404 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:28.376879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 691/1377] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:28.382287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56686-2fbe-475b-9246-3dca16a0f268 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:28.382697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56686-2fbe-475b-9246-3dca16a0f268 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:28.382697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d56686-2fbe-475b-9246-3dca16a0f268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:28.453129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-90d56686-2fbe-475b-9246-3dca16a0f268 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:28.454383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-90d56686-2fbe-475b-9246-3dca16a0f268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:28.461091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:28.566176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 687/1378] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:28.616341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d24459-c4fe-4387-b12c-98e1f51d3404 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:28.618169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a3d24459-c4fe-4387-b12c-98e1f51d3404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:28.688585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:28.774741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d24459-c4fe-4387-b12c-98e1f51d3404 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:28.894893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcd6f1-7e61-4d76-98c2-a8ef05644c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:28.895515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcd6f1-7e61-4d76-98c2-a8ef05644c42 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:28.895788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcd6f1-7e61-4d76-98c2-a8ef05644c42 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:28.896061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcd6f1-7e61-4d76-98c2-a8ef05644c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:28.897670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-29fcd6f1-7e61-4d76-98c2-a8ef05644c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:28.924919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:29.032072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcd6f1-7e61-4d76-98c2-a8ef05644c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:29.033691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcd6f1-7e61-4d76-98c2-a8ef05644c42 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:29.059430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 692/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:31.122937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e12f-9439-4a55-9dec-bfc5839f7706 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:31.123634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e12f-9439-4a55-9dec-bfc5839f7706 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:31.123634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1e12f-9439-4a55-9dec-bfc5839f7706 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:31.125051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 688/1380] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:31.130601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd2e8-ecd6-4259-94ad-22fa6545a8cc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:31.131134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd2e8-ecd6-4259-94ad-22fa6545a8cc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:31.131134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fd2e8-ecd6-4259-94ad-22fa6545a8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:31.201132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8c2fd2e8-ecd6-4259-94ad-22fa6545a8cc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:31.202467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8c2fd2e8-ecd6-4259-94ad-22fa6545a8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:31.303863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:31.314073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 693/1381] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:31.360522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e12f-9439-4a55-9dec-bfc5839f7706 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:31.362268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-65b1e12f-9439-4a55-9dec-bfc5839f7706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:31.511577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:31.524861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1e12f-9439-4a55-9dec-bfc5839f7706 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:31.641112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f814-d651-4f23-8c8d-f71e85f53191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:31.641821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f814-d651-4f23-8c8d-f71e85f53191 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:31.642551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f814-d651-4f23-8c8d-f71e85f53191 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:31.642882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f814-d651-4f23-8c8d-f71e85f53191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:31.644549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6f89f814-d651-4f23-8c8d-f71e85f53191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:31.739018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89f814-d651-4f23-8c8d-f71e85f53191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:31.741181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89f814-d651-4f23-8c8d-f71e85f53191 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:31.752395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:31.761731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 689/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:33.821017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283eda5-7684-4736-b1a0-5411ccf8b70c None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:33.821593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283eda5-7684-4736-b1a0-5411ccf8b70c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:33.821593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283eda5-7684-4736-b1a0-5411ccf8b70c None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:33.823380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 694/1383] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:33.830621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56264-b109-4322-a13c-b49f14652090 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:33.831057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56264-b109-4322-a13c-b49f14652090 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:33.831212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af56264-b109-4322-a13c-b49f14652090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:33.902115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8af56264-b109-4322-a13c-b49f14652090 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:33.903368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8af56264-b109-4322-a13c-b49f14652090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:34.007560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 690/1384] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:34.058438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283eda5-7684-4736-b1a0-5411ccf8b70c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:34.062411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d283eda5-7684-4736-b1a0-5411ccf8b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:34.278562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283eda5-7684-4736-b1a0-5411ccf8b70c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:34.358479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:34.413493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614eaa3-13f4-4b35-b5b5-8e9bf8a0cf46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:34.414183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614eaa3-13f4-4b35-b5b5-8e9bf8a0cf46 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:34.414456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614eaa3-13f4-4b35-b5b5-8e9bf8a0cf46 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:34.414719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614eaa3-13f4-4b35-b5b5-8e9bf8a0cf46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:34.416420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f614eaa3-13f4-4b35-b5b5-8e9bf8a0cf46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:34.519072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614eaa3-13f4-4b35-b5b5-8e9bf8a0cf46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:34.520765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614eaa3-13f4-4b35-b5b5-8e9bf8a0cf46 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:34.540582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 695/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:36.595943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb859a1-12a9-4c2c-a63c-1bc830a4601e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:36.596560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb859a1-12a9-4c2c-a63c-1bc830a4601e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:36.596560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb859a1-12a9-4c2c-a63c-1bc830a4601e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:36.598317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 691/1386] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:36.604219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caffb1-46dd-446f-bfe9-784d5ba9c2e1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:36.604955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caffb1-46dd-446f-bfe9-784d5ba9c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:36.604955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caffb1-46dd-446f-bfe9-784d5ba9c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:36.698942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e2caffb1-46dd-446f-bfe9-784d5ba9c2e1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:36.700395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e2caffb1-46dd-446f-bfe9-784d5ba9c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:36.736970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:36.804890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 696/1387] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:36.855111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb859a1-12a9-4c2c-a63c-1bc830a4601e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:36.856725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ddb859a1-12a9-4c2c-a63c-1bc830a4601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:36.944106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:37.026084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb859a1-12a9-4c2c-a63c-1bc830a4601e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:37.158651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e941e-def6-4b83-93d0-25a92a58b353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:37.159278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e941e-def6-4b83-93d0-25a92a58b353 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:37.159568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e941e-def6-4b83-93d0-25a92a58b353 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:37.159836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e941e-def6-4b83-93d0-25a92a58b353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:37.161719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-614e941e-def6-4b83-93d0-25a92a58b353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:37.209094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:37.268962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e941e-def6-4b83-93d0-25a92a58b353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:37.270741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e941e-def6-4b83-93d0-25a92a58b353 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:37.294215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 692/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:39.346573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cac9df-7099-421e-900d-f6ce6be422ec None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:39.347193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cac9df-7099-421e-900d-f6ce6be422ec None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:39.347193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cac9df-7099-421e-900d-f6ce6be422ec None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:39.348504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 697/1389] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:39.353842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82350a7-c374-410c-86bf-6c0414f73417 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:39.354315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82350a7-c374-410c-86bf-6c0414f73417 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:39.354437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82350a7-c374-410c-86bf-6c0414f73417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:39.423660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f82350a7-c374-410c-86bf-6c0414f73417 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:39.424888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f82350a7-c374-410c-86bf-6c0414f73417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:39.527347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 693/1390] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:39.571688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cac9df-7099-421e-900d-f6ce6be422ec None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:39.573244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-40cac9df-7099-421e-900d-f6ce6be422ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:39.728875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cac9df-7099-421e-900d-f6ce6be422ec None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:39.747108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:39.845613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6dbf2-261f-4dbf-9c97-49aaaf2bd74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:39.846277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6dbf2-261f-4dbf-9c97-49aaaf2bd74a service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:39.846550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6dbf2-261f-4dbf-9c97-49aaaf2bd74a service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:39.846820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6dbf2-261f-4dbf-9c97-49aaaf2bd74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:39.848479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-19d6dbf2-261f-4dbf-9c97-49aaaf2bd74a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:39.937169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6dbf2-261f-4dbf-9c97-49aaaf2bd74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:39.938812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6dbf2-261f-4dbf-9c97-49aaaf2bd74a service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:39.956929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 698/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:40.581888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75fd49-bb73-4212-bab6-a2cfefc1b690 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:40.582397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75fd49-bb73-4212-bab6-a2cfefc1b690 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:40.582611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75fd49-bb73-4212-bab6-a2cfefc1b690 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:40.584050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 694/1392] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:40.589657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4a27-f38f-46d3-8def-f4813c2f121d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:40.590143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4a27-f38f-46d3-8def-f4813c2f121d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:40.590255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e4a27-f38f-46d3-8def-f4813c2f121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:40.616744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:40.659998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7b5e4a27-f38f-46d3-8def-f4813c2f121d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:40.661217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7b5e4a27-f38f-46d3-8def-f4813c2f121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:40.764482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 699/1393] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:13:40.820964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8437cc-c64f-4659-998d-182d0c5e7510 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:40.821358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8437cc-c64f-4659-998d-182d0c5e7510 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:40.821694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8437cc-c64f-4659-998d-182d0c5e7510 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:40.823198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 695/1394] 10.222.0.17 () {54 vars in 966 bytes} [Sat Aug 6 01:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:40.828487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fadb1-5385-4ac4-bf7f-000b818c5370 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:40.828780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fadb1-5385-4ac4-bf7f-000b818c5370 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:40.829053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fadb1-5385-4ac4-bf7f-000b818c5370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:40.909103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b49fadb1-5385-4ac4-bf7f-000b818c5370 None None] MFA Rules not processed for user `0131e4a3492c42c492c47a715a2bccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:40.910368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b49fadb1-5385-4ac4-bf7f-000b818c5370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:40.952749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:40.989629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 700/1395] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Aug 6 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:40.997333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8437cc-c64f-4659-998d-182d0c5e7510 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:40.998997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ca8437cc-c64f-4659-998d-182d0c5e7510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:41.012661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:41.108184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8437cc-c64f-4659-998d-182d0c5e7510 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:41.185789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aea7e3-61bb-4d2a-89de-0992261203ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:41.186439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aea7e3-61bb-4d2a-89de-0992261203ca service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:41.186711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aea7e3-61bb-4d2a-89de-0992261203ca service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:41.186978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aea7e3-61bb-4d2a-89de-0992261203ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:41.188591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-17aea7e3-61bb-4d2a-89de-0992261203ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:41.256982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:41.299337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aea7e3-61bb-4d2a-89de-0992261203ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:41.300811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aea7e3-61bb-4d2a-89de-0992261203ca service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:41.318768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 696/1396] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:41.964516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bda52d-928e-4091-bcd2-5428a449ef4e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:41.965120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bda52d-928e-4091-bcd2-5428a449ef4e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:41.965120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bda52d-928e-4091-bcd2-5428a449ef4e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:41.966504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 701/1397] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:41.972543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:41.973097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:41.973097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:42.049673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:42.051137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:42.068362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53053cb-1607-496d-ae65-78c83774aa3e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:42.068645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53053cb-1607-496d-ae65-78c83774aa3e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:42.068922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53053cb-1607-496d-ae65-78c83774aa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:42.142391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a53053cb-1607-496d-ae65-78c83774aa3e None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:42.143661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a53053cb-1607-496d-ae65-78c83774aa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:42.153865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 697/1398] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:42.198723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:42.199948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:42.226922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:42.231442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 702/1399] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:13:42.274828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9484b9-1c92-4dae-ac7c-9f338f889dbb None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:42.275121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9484b9-1c92-4dae-ac7c-9f338f889dbb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:42.275404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9484b9-1c92-4dae-ac7c-9f338f889dbb None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:42.276971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 703/1400] 10.222.0.17 () {54 vars in 943 bytes} [Sat Aug 6 01:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:42.283468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018b716-ab62-4766-bfc3-324504dcfeaa None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:42.283826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018b716-ab62-4766-bfc3-324504dcfeaa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:42.284123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018b716-ab62-4766-bfc3-324504dcfeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:42.319693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4dd92-b3f2-4427-935c-a0f80783cabf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:42.353332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:42.361572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1018b716-ab62-4766-bfc3-324504dcfeaa None None] MFA Rules not processed for user `04de0ae1701b4367bf5be9da982bb251`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:42.362834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1018b716-ab62-4766-bfc3-324504dcfeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:42.436122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb37e742-f604-49ae-b6cf-fd26c9091e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:42.436762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37e742-f604-49ae-b6cf-fd26c9091e77 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:42.437041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37e742-f604-49ae-b6cf-fd26c9091e77 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:42.437316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb37e742-f604-49ae-b6cf-fd26c9091e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:42.439000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eb37e742-f604-49ae-b6cf-fd26c9091e77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:42.456929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:42.475485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 704/1401] 10.222.0.17 () {58 vars in 1040 bytes} [Sat Aug 6 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:42.485102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018b716-ab62-4766-bfc3-324504dcfeaa None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:42.495449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018b716-ab62-4766-bfc3-324504dcfeaa None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:42.533235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37e742-f604-49ae-b6cf-fd26c9091e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:42.534887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb37e742-f604-49ae-b6cf-fd26c9091e77 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:42.553577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 698/1402] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:42.605963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fdad2-895e-45fb-9ee5-08001154f2e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:42.606619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdad2-895e-45fb-9ee5-08001154f2e8 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:42.606898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdad2-895e-45fb-9ee5-08001154f2e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:42.607163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fdad2-895e-45fb-9ee5-08001154f2e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:42.609204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2e4fdad2-895e-45fb-9ee5-08001154f2e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:42.611995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:42.714741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fdad2-895e-45fb-9ee5-08001154f2e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:42.716388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fdad2-895e-45fb-9ee5-08001154f2e8 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:42.725682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 705/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:13:44.574576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce907-6cf3-48b2-afdc-6682bbf3e27c None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:44.575469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce907-6cf3-48b2-afdc-6682bbf3e27c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:44.575752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce907-6cf3-48b2-afdc-6682bbf3e27c None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:44.577244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 699/1404] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:44.582602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b61a-764e-4b80-bc49-c9d7e4a77f04 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:44.583034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b61a-764e-4b80-bc49-c9d7e4a77f04 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:44.583134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0b61a-764e-4b80-bc49-c9d7e4a77f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:44.658613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-64f0b61a-764e-4b80-bc49-c9d7e4a77f04 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:44.660867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-64f0b61a-764e-4b80-bc49-c9d7e4a77f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:44.757503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:44.766268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 706/1405] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:44.817445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce907-6cf3-48b2-afdc-6682bbf3e27c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:44.819044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-457ce907-6cf3-48b2-afdc-6682bbf3e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:44.974660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:44.979397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce907-6cf3-48b2-afdc-6682bbf3e27c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:45.106400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2fb38-8c39-4684-837a-3c84efe84813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:45.107059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2fb38-8c39-4684-837a-3c84efe84813 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:45.107467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2fb38-8c39-4684-837a-3c84efe84813 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:45.107755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2fb38-8c39-4684-837a-3c84efe84813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:45.109431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4f2fb38-8c39-4684-837a-3c84efe84813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:45.204177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2fb38-8c39-4684-837a-3c84efe84813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:45.206414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2fb38-8c39-4684-837a-3c84efe84813 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:45.246334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 700/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:47.346615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0108-0a87-4f2c-a1f6-53bc7350e10f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:47.346615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0108-0a87-4f2c-a1f6-53bc7350e10f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:47.347305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d0108-0a87-4f2c-a1f6-53bc7350e10f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:47.350374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 707/1407] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:13:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:13:47.353701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ba021-a77a-4fdc-8db0-f20956ebf4be None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:47.354235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ba021-a77a-4fdc-8db0-f20956ebf4be None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:47.354343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ba021-a77a-4fdc-8db0-f20956ebf4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:47.359561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:47.425955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7e1ba021-a77a-4fdc-8db0-f20956ebf4be None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:13:47.427195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7e1ba021-a77a-4fdc-8db0-f20956ebf4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:47.541565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 701/1408] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:13:47.587600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d0108-0a87-4f2c-a1f6-53bc7350e10f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:13:47.589233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5e7d0108-0a87-4f2c-a1f6-53bc7350e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:47.772822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d0108-0a87-4f2c-a1f6-53bc7350e10f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:13:47.850498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:47.908015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49448a08-4e5c-488a-ad86-abea8f506890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:13:47.908659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448a08-4e5c-488a-ad86-abea8f506890 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:13:47.908940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448a08-4e5c-488a-ad86-abea8f506890 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:13:47.909216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49448a08-4e5c-488a-ad86-abea8f506890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:13:47.911589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-49448a08-4e5c-488a-ad86-abea8f506890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:13:48.015627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49448a08-4e5c-488a-ad86-abea8f506890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:13:48.017730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49448a08-4e5c-488a-ad86-abea8f506890 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:13:48.039028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 708/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:13:57.539408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=64 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:13:58.036389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=64 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:04.501168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195748f8-5e23-44b9-bc42-15a4485ebb21 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:04.501754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195748f8-5e23-44b9-bc42-15a4485ebb21 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:04.501754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195748f8-5e23-44b9-bc42-15a4485ebb21 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:04.503169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 702/1410] 10.222.0.17 () {54 vars in 918 bytes} [Sat Aug 6 01:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:04.508640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d542-a9e7-4e21-9ec0-962ea7d8630d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:04.509118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d542-a9e7-4e21-9ec0-962ea7d8630d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:04.509118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330d542-a9e7-4e21-9ec0-962ea7d8630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:04.587134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8330d542-a9e7-4e21-9ec0-962ea7d8630d None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:04.588361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8330d542-a9e7-4e21-9ec0-962ea7d8630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:04.699413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 709/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Aug 6 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:04.719055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199a81-697e-41cb-b698-c128f214123d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:04.719336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199a81-697e-41cb-b698-c128f214123d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:04.719633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3199a81-697e-41cb-b698-c128f214123d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:04.721079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 703/1412] 10.222.0.17 () {54 vars in 918 bytes} [Sat Aug 6 01:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:04.725850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db89-d237-402f-ac18-005e37bdfb3b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:04.726174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db89-d237-402f-ac18-005e37bdfb3b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:04.726444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41db89-d237-402f-ac18-005e37bdfb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:04.803407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:04.806054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1d41db89-d237-402f-ac18-005e37bdfb3b None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:04.807576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1d41db89-d237-402f-ac18-005e37bdfb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:04.931061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 710/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Sat Aug 6 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:07.394336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7648-2c06-45c4-8168-f3ee6039d025 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:07.395221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7648-2c06-45c4-8168-f3ee6039d025 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:07.395221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f7648-2c06-45c4-8168-f3ee6039d025 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:07.397301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:07.403604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e17a-6124-41d9-90c7-b4c16ad14acd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:07.404290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e17a-6124-41d9-90c7-b4c16ad14acd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:07.404549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768e17a-6124-41d9-90c7-b4c16ad14acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:07.489452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8768e17a-6124-41d9-90c7-b4c16ad14acd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:07.490691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8768e17a-6124-41d9-90c7-b4c16ad14acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:07.553338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:07.596647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:07.647188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f7648-2c06-45c4-8168-f3ee6039d025 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:07.649345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ab7f7648-2c06-45c4-8168-f3ee6039d025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:07.802863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f7648-2c06-45c4-8168-f3ee6039d025 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:07.878407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:07.920350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b01d3-2863-437e-b45b-44ee40c5c6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:07.920985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b01d3-2863-437e-b45b-44ee40c5c6ee service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:07.921265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b01d3-2863-437e-b45b-44ee40c5c6ee service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:07.921533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b01d3-2863-437e-b45b-44ee40c5c6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:07.923237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b25b01d3-2863-437e-b45b-44ee40c5c6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:08.028382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b01d3-2863-437e-b45b-44ee40c5c6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:08.030050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b01d3-2863-437e-b45b-44ee40c5c6ee service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:08.048998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 705/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:08.944514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fc8a-ec64-4dc4-9773-3e4c3c211f15 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:08.945082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fc8a-ec64-4dc4-9773-3e4c3c211f15 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:08.945082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fc8a-ec64-4dc4-9773-3e4c3c211f15 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:08.946506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:08.952665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c708e9-e6c6-488f-8291-bda88f79bc37 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:08.953217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c708e9-e6c6-488f-8291-bda88f79bc37 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:08.953380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c708e9-e6c6-488f-8291-bda88f79bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:09.044112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-18c708e9-e6c6-488f-8291-bda88f79bc37 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:09.045370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-18c708e9-e6c6-488f-8291-bda88f79bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:09.073018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:09.146924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:09.298519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5fc8a-ec64-4dc4-9773-3e4c3c211f15 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:09.301200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aba5fc8a-ec64-4dc4-9773-3e4c3c211f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:09.467715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5fc8a-ec64-4dc4-9773-3e4c3c211f15 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:09.509938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:09.586659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98edb5-8043-4755-8d24-ee1e9e12c271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:09.587217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98edb5-8043-4755-8d24-ee1e9e12c271 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:09.587496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98edb5-8043-4755-8d24-ee1e9e12c271 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:09.587768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98edb5-8043-4755-8d24-ee1e9e12c271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:09.589427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9a98edb5-8043-4755-8d24-ee1e9e12c271 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:09.687176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98edb5-8043-4755-8d24-ee1e9e12c271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:09.688806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98edb5-8043-4755-8d24-ee1e9e12c271 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:09.707464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 713/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:10.590488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c233-54fb-4e8f-9e02-03ec1483a2c4 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:10.590958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c233-54fb-4e8f-9e02-03ec1483a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:10.591055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1c233-54fb-4e8f-9e02-03ec1483a2c4 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:10.592418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:10.597806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0995-9431-42d7-9703-adc748f17ef7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:10.598273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0995-9431-42d7-9703-adc748f17ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:10.598403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0995-9431-42d7-9703-adc748f17ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:10.654560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:10.678844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-943a0995-9431-42d7-9703-adc748f17ef7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:10.680097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-943a0995-9431-42d7-9703-adc748f17ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:10.787143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:10.941351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c233-54fb-4e8f-9e02-03ec1483a2c4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:10.943647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-97a1c233-54fb-4e8f-9e02-03ec1483a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:11.103337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1c233-54fb-4e8f-9e02-03ec1483a2c4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:11.115672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:11.224373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6613c5-f962-4ac6-8b74-03c04b48f581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:11.224995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6613c5-f962-4ac6-8b74-03c04b48f581 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:11.225270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6613c5-f962-4ac6-8b74-03c04b48f581 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:11.225539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6613c5-f962-4ac6-8b74-03c04b48f581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:11.227191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c6613c5-f962-4ac6-8b74-03c04b48f581 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:11.318698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6613c5-f962-4ac6-8b74-03c04b48f581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:11.320309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6613c5-f962-4ac6-8b74-03c04b48f581 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:11.338436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 708/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:12.194909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf8767-1821-4945-842b-53df0cfc6b1f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:12.195482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf8767-1821-4945-842b-53df0cfc6b1f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:12.195482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf8767-1821-4945-842b-53df0cfc6b1f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:12.197445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:12.205164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192984-61b8-41d8-b1a7-6750dab59b4c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:12.205638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192984-61b8-41d8-b1a7-6750dab59b4c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:12.205744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4192984-61b8-41d8-b1a7-6750dab59b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:12.226798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:12.283081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a4192984-61b8-41d8-b1a7-6750dab59b4c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:12.284280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a4192984-61b8-41d8-b1a7-6750dab59b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:12.387329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:14:12.541150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf8767-1821-4945-842b-53df0cfc6b1f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:12.542685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-abcf8767-1821-4945-842b-53df0cfc6b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:12.662613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:12.700489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf8767-1821-4945-842b-53df0cfc6b1f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:12.825858 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff89f44-42af-4001-9f62-d888b33fd368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:12.826405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89f44-42af-4001-9f62-d888b33fd368 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:12.826685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89f44-42af-4001-9f62-d888b33fd368 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:12.826955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff89f44-42af-4001-9f62-d888b33fd368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:12.828625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-eff89f44-42af-4001-9f62-d888b33fd368 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:12.910483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:12.926301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff89f44-42af-4001-9f62-d888b33fd368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:12.927925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff89f44-42af-4001-9f62-d888b33fd368 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:12.951827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 716/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:13.811702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c6e42-c1ea-493f-9231-ffd29351f195 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:13.812320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c6e42-c1ea-493f-9231-ffd29351f195 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:13.812320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c6e42-c1ea-493f-9231-ffd29351f195 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:13.813610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:13.819612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0466d6-f3f8-490c-a7a7-cb97b2bc71b0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:13.820037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0466d6-f3f8-490c-a7a7-cb97b2bc71b0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:13.820174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0466d6-f3f8-490c-a7a7-cb97b2bc71b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:13.905437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fa0466d6-f3f8-490c-a7a7-cb97b2bc71b0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:13.906675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fa0466d6-f3f8-490c-a7a7-cb97b2bc71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:14.004688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:14.155559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c6e42-c1ea-493f-9231-ffd29351f195 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:14.157017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b32c6e42-c1ea-493f-9231-ffd29351f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:14.249957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:14.319331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c6e42-c1ea-493f-9231-ffd29351f195 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:14.446221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a7743-4965-46bd-a1b5-b7785838bd68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:14.446854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a7743-4965-46bd-a1b5-b7785838bd68 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:14.447133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a7743-4965-46bd-a1b5-b7785838bd68 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:14.447402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a7743-4965-46bd-a1b5-b7785838bd68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:14.449041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-776a7743-4965-46bd-a1b5-b7785838bd68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:14.498082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:14.540772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a7743-4965-46bd-a1b5-b7785838bd68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:14.542437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a7743-4965-46bd-a1b5-b7785838bd68 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:14.560882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 711/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:15.364510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56a123-08fd-43a0-8c45-b4a9ce5fc23e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:15.365448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56a123-08fd-43a0-8c45-b4a9ce5fc23e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:15.365448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56a123-08fd-43a0-8c45-b4a9ce5fc23e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:15.367670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:15.375676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f58c-1029-4632-91a2-6b040a0d54ce None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:15.376083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f58c-1029-4632-91a2-6b040a0d54ce None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:15.376254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f58c-1029-4632-91a2-6b040a0d54ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:15.456395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a311f58c-1029-4632-91a2-6b040a0d54ce None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:15.457609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a311f58c-1029-4632-91a2-6b040a0d54ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:15.560000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:15.710420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56a123-08fd-43a0-8c45-b4a9ce5fc23e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:15.712806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5d56a123-08fd-43a0-8c45-b4a9ce5fc23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:15.772708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:15.882094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56a123-08fd-43a0-8c45-b4a9ce5fc23e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:15.999593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1afe3-631d-40d4-b314-93e6d7678588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:16.000195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1afe3-631d-40d4-b314-93e6d7678588 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:16.000473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1afe3-631d-40d4-b314-93e6d7678588 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:16.000739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1afe3-631d-40d4-b314-93e6d7678588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:16.002522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-abc1afe3-631d-40d4-b314-93e6d7678588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:16.010097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:16.102476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1afe3-631d-40d4-b314-93e6d7678588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:16.104097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1afe3-631d-40d4-b314-93e6d7678588 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:16.123175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 719/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:16.928817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f1472-17de-4ad0-bc7b-bcfa5846e784 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:16.929707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f1472-17de-4ad0-bc7b-bcfa5846e784 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:16.929707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f1472-17de-4ad0-bc7b-bcfa5846e784 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:16.931966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:16.940000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fcd6-130c-4f58-9092-d8342989b03c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:16.940461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fcd6-130c-4f58-9092-d8342989b03c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:16.940560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1fcd6-130c-4f58-9092-d8342989b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:17.023889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-88d1fcd6-130c-4f58-9092-d8342989b03c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:17.025122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-88d1fcd6-130c-4f58-9092-d8342989b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:17.099401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:17.133540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:17.285920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f1472-17de-4ad0-bc7b-bcfa5846e784 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:17.287506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-612f1472-17de-4ad0-bc7b-bcfa5846e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:17.305896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:17.443551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f1472-17de-4ad0-bc7b-bcfa5846e784 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:17.532983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:17.560313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc7e6d-56f2-4eb7-9b1c-852b6821d5c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:17.560953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7e6d-56f2-4eb7-9b1c-852b6821d5c8 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:17.561234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7e6d-56f2-4eb7-9b1c-852b6821d5c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:17.561498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc7e6d-56f2-4eb7-9b1c-852b6821d5c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:17.563240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-20bc7e6d-56f2-4eb7-9b1c-852b6821d5c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:17.656730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc7e6d-56f2-4eb7-9b1c-852b6821d5c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:17.658398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc7e6d-56f2-4eb7-9b1c-852b6821d5c8 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:17.676566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 714/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:18.471042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3aa5a-7349-453e-bffb-88caaf095669 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:18.471955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3aa5a-7349-453e-bffb-88caaf095669 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:18.471955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff3aa5a-7349-453e-bffb-88caaf095669 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:18.474293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:18.482829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13502a60-6f84-402f-923c-0183e1f2c7c6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:18.483268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13502a60-6f84-402f-923c-0183e1f2c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:18.483401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13502a60-6f84-402f-923c-0183e1f2c7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:18.566899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-13502a60-6f84-402f-923c-0183e1f2c7c6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:18.568608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-13502a60-6f84-402f-923c-0183e1f2c7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:18.616455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:18.683367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:18.843702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3aa5a-7349-453e-bffb-88caaf095669 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:18.845123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dff3aa5a-7349-453e-bffb-88caaf095669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:19.005197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff3aa5a-7349-453e-bffb-88caaf095669 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:19.065453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:19.128819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bc323-1f99-4980-9d88-99d7091ad28d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:19.129360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc323-1f99-4980-9d88-99d7091ad28d service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:19.129639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc323-1f99-4980-9d88-99d7091ad28d service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:19.129910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bc323-1f99-4980-9d88-99d7091ad28d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:19.131624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e74bc323-1f99-4980-9d88-99d7091ad28d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:19.235718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc323-1f99-4980-9d88-99d7091ad28d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:19.237327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bc323-1f99-4980-9d88-99d7091ad28d service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:19.255531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 722/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:20.050108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c9f7-1015-4b4c-bf5a-f317b649b3d6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:20.050720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c9f7-1015-4b4c-bf5a-f317b649b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:20.050720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c9f7-1015-4b4c-bf5a-f317b649b3d6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:20.052057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:20.057483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ab7ab-0c8f-4a40-9ce0-55be72b9a57b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:20.057964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ab7ab-0c8f-4a40-9ce0-55be72b9a57b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:20.058097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ab7ab-0c8f-4a40-9ce0-55be72b9a57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:20.145639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f32ab7ab-0c8f-4a40-9ce0-55be72b9a57b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:20.146904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f32ab7ab-0c8f-4a40-9ce0-55be72b9a57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:20.148983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:20.246106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:20.398602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c9f7-1015-4b4c-bf5a-f317b649b3d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:20.401001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9407c9f7-1015-4b4c-bf5a-f317b649b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:20.557961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c9f7-1015-4b4c-bf5a-f317b649b3d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:20.586968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:20.675478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d8e87-aeba-4adb-83e2-3eb87e49c817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:20.676115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8e87-aeba-4adb-83e2-3eb87e49c817 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:20.676400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8e87-aeba-4adb-83e2-3eb87e49c817 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:20.676679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d8e87-aeba-4adb-83e2-3eb87e49c817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:20.678355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba8d8e87-aeba-4adb-83e2-3eb87e49c817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:20.779325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8e87-aeba-4adb-83e2-3eb87e49c817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:20.780983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8d8e87-aeba-4adb-83e2-3eb87e49c817 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:20.799673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 717/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:22.690390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7f97-a92c-4ae2-b9f3-a9d29e375fd4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:22.690967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7f97-a92c-4ae2-b9f3-a9d29e375fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:22.690967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7f97-a92c-4ae2-b9f3-a9d29e375fd4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:22.692319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:22.698656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab042e-dfe9-4df2-9bec-9ff670fe1aeb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:22.699400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab042e-dfe9-4df2-9bec-9ff670fe1aeb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:22.699552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab042e-dfe9-4df2-9bec-9ff670fe1aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:22.749387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:22.777367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a7ab042e-dfe9-4df2-9bec-9ff670fe1aeb None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:22.778537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a7ab042e-dfe9-4df2-9bec-9ff670fe1aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:22.880305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:22.925168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7f97-a92c-4ae2-b9f3-a9d29e375fd4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:22.926742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-50bf7f97-a92c-4ae2-b9f3-a9d29e375fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:23.036292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7f97-a92c-4ae2-b9f3-a9d29e375fd4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:23.071129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:23.115982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b990dc-99a8-4856-8bdb-5c089ecfbd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:23.116601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b990dc-99a8-4856-8bdb-5c089ecfbd00 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:23.116869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b990dc-99a8-4856-8bdb-5c089ecfbd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:23.117160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b990dc-99a8-4856-8bdb-5c089ecfbd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:23.119139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b9b990dc-99a8-4856-8bdb-5c089ecfbd00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:23.233371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b990dc-99a8-4856-8bdb-5c089ecfbd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:23.234885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b990dc-99a8-4856-8bdb-5c089ecfbd00 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:23.253629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 725/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:25.365372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662b75c-47cc-48cf-8faf-369877c638f2 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:25.366289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662b75c-47cc-48cf-8faf-369877c638f2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:25.366289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662b75c-47cc-48cf-8faf-369877c638f2 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:25.368415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:25.374855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d7d6-03e0-4d50-ba9f-13b48f2cd0e6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:25.375603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d7d6-03e0-4d50-ba9f-13b48f2cd0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:25.375777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4d7d6-03e0-4d50-ba9f-13b48f2cd0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:25.452454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-48b4d7d6-03e0-4d50-ba9f-13b48f2cd0e6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:25.453678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-48b4d7d6-03e0-4d50-ba9f-13b48f2cd0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:25.468497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:25.558972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:25.609087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662b75c-47cc-48cf-8faf-369877c638f2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:25.611685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7662b75c-47cc-48cf-8faf-369877c638f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:25.727288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662b75c-47cc-48cf-8faf-369877c638f2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:25.739797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:25.804521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0710ec5-1eeb-4464-a3a4-49ad6192d644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:25.805143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0710ec5-1eeb-4464-a3a4-49ad6192d644 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:25.805425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0710ec5-1eeb-4464-a3a4-49ad6192d644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:25.805697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0710ec5-1eeb-4464-a3a4-49ad6192d644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:25.807359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f0710ec5-1eeb-4464-a3a4-49ad6192d644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:25.922532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0710ec5-1eeb-4464-a3a4-49ad6192d644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:25.924015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0710ec5-1eeb-4464-a3a4-49ad6192d644 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:25.943690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 720/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:28.256147 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d28b-f027-4b91-82ad-ba8ffa2bb58a None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:28.257030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d28b-f027-4b91-82ad-ba8ffa2bb58a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:28.257150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261d28b-f027-4b91-82ad-ba8ffa2bb58a None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:28.259507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:28.265402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69561ea-0c8f-473f-9525-c169e99db746 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:28.265823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69561ea-0c8f-473f-9525-c169e99db746 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:28.265914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69561ea-0c8f-473f-9525-c169e99db746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:28.317041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:28.336550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b69561ea-0c8f-473f-9525-c169e99db746 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:28.337768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b69561ea-0c8f-473f-9525-c169e99db746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:28.441916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:28.486192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d28b-f027-4b91-82ad-ba8ffa2bb58a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:28.488597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9261d28b-f027-4b91-82ad-ba8ffa2bb58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:28.615660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261d28b-f027-4b91-82ad-ba8ffa2bb58a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:28.662575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:28.699032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f07166-b69f-4a66-9f61-1abe89f6b55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:28.699660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07166-b69f-4a66-9f61-1abe89f6b55d service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:28.699935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07166-b69f-4a66-9f61-1abe89f6b55d service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:28.700206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f07166-b69f-4a66-9f61-1abe89f6b55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:28.701827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52f07166-b69f-4a66-9f61-1abe89f6b55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:28.809376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f07166-b69f-4a66-9f61-1abe89f6b55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:28.810840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f07166-b69f-4a66-9f61-1abe89f6b55d service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:28.830558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 728/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:30.936671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a01d-6058-4ac6-bb2f-fce91506863d None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:30.937258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a01d-6058-4ac6-bb2f-fce91506863d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:30.937258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2a01d-6058-4ac6-bb2f-fce91506863d None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:30.938923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:14:30.944385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f76c98-cae2-4a5c-b3bc-2e460f6f61e0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:30.944824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f76c98-cae2-4a5c-b3bc-2e460f6f61e0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:30.944919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f76c98-cae2-4a5c-b3bc-2e460f6f61e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:31.018188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-63f76c98-cae2-4a5c-b3bc-2e460f6f61e0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:31.019402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-63f76c98-cae2-4a5c-b3bc-2e460f6f61e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:31.040897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:31.117030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:31.158016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a01d-6058-4ac6-bb2f-fce91506863d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:31.159601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-55d2a01d-6058-4ac6-bb2f-fce91506863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:31.268250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2a01d-6058-4ac6-bb2f-fce91506863d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:31.289034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:31.475957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dbb7d-c41e-44f8-8b1d-8f9d968e9b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:31.476584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbb7d-c41e-44f8-8b1d-8f9d968e9b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:31.476868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbb7d-c41e-44f8-8b1d-8f9d968e9b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:31.477125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbb7d-c41e-44f8-8b1d-8f9d968e9b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:31.478781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a84dbb7d-c41e-44f8-8b1d-8f9d968e9b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:31.598063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dbb7d-c41e-44f8-8b1d-8f9d968e9b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:31.599453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dbb7d-c41e-44f8-8b1d-8f9d968e9b43 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:31.618690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 723/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:33.649894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdc8f-c668-4f87-bd3d-9d5b0a2c0c90 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:33.650509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdc8f-c668-4f87-bd3d-9d5b0a2c0c90 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:33.650509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdc8f-c668-4f87-bd3d-9d5b0a2c0c90 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:33.651861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:33.658186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65642f-bc16-4f37-b906-4cd43762c091 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:33.658661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65642f-bc16-4f37-b906-4cd43762c091 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:33.658763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65642f-bc16-4f37-b906-4cd43762c091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:33.728052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:33.731315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ae65642f-bc16-4f37-b906-4cd43762c091 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:33.733321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ae65642f-bc16-4f37-b906-4cd43762c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:33.838323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:33.877908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdc8f-c668-4f87-bd3d-9d5b0a2c0c90 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:33.879484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-702bdc8f-c668-4f87-bd3d-9d5b0a2c0c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:34.007120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdc8f-c668-4f87-bd3d-9d5b0a2c0c90 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:34.061906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:34.088083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f46c9f-0808-4ded-b1a5-a46858adc6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:34.088769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46c9f-0808-4ded-b1a5-a46858adc6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:34.088982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46c9f-0808-4ded-b1a5-a46858adc6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:34.089246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46c9f-0808-4ded-b1a5-a46858adc6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:34.090896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-85f46c9f-0808-4ded-b1a5-a46858adc6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:34.211316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f46c9f-0808-4ded-b1a5-a46858adc6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:34.213498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f46c9f-0808-4ded-b1a5-a46858adc6a4 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:34.239778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 731/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:36.269838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af996bf2-5d16-4b1e-8ef7-bd7a1e7e93b8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:36.270463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af996bf2-5d16-4b1e-8ef7-bd7a1e7e93b8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:36.270463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af996bf2-5d16-4b1e-8ef7-bd7a1e7e93b8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:36.271804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:36.277225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152699-ae6c-4648-932a-6d682fd68252 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:36.277679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152699-ae6c-4648-932a-6d682fd68252 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:36.277799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be152699-ae6c-4648-932a-6d682fd68252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:36.352036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-be152699-ae6c-4648-932a-6d682fd68252 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:36.353262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-be152699-ae6c-4648-932a-6d682fd68252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:36.382691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:36.458757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:36.505815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af996bf2-5d16-4b1e-8ef7-bd7a1e7e93b8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:36.507391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-af996bf2-5d16-4b1e-8ef7-bd7a1e7e93b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:36.620113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af996bf2-5d16-4b1e-8ef7-bd7a1e7e93b8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:36.651465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:36.699233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5adbbd-65e0-4090-bb8e-bfaeb48aa85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:36.699856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5adbbd-65e0-4090-bb8e-bfaeb48aa85a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:36.700135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5adbbd-65e0-4090-bb8e-bfaeb48aa85a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:36.700407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5adbbd-65e0-4090-bb8e-bfaeb48aa85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:36.702207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd5adbbd-65e0-4090-bb8e-bfaeb48aa85a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:36.817845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5adbbd-65e0-4090-bb8e-bfaeb48aa85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:36.819344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5adbbd-65e0-4090-bb8e-bfaeb48aa85a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:36.838237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 726/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:38.878498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be208a6-86c7-4e2e-821c-3837706c88c4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:38.879089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be208a6-86c7-4e2e-821c-3837706c88c4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:38.879089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be208a6-86c7-4e2e-821c-3837706c88c4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:38.880361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:38.886918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531576c6-18d9-4181-8a02-a29b362b7abc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:38.887639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531576c6-18d9-4181-8a02-a29b362b7abc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:38.887795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531576c6-18d9-4181-8a02-a29b362b7abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:38.957001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-531576c6-18d9-4181-8a02-a29b362b7abc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:38.958250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-531576c6-18d9-4181-8a02-a29b362b7abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:38.966670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:39.060512 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:39.101914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be208a6-86c7-4e2e-821c-3837706c88c4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:39.104299 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7be208a6-86c7-4e2e-821c-3837706c88c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:39.218821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be208a6-86c7-4e2e-821c-3837706c88c4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:39.274537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:39.293968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4798a3-fb91-4787-8153-67fd35326fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:39.294619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4798a3-fb91-4787-8153-67fd35326fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:39.294892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4798a3-fb91-4787-8153-67fd35326fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:39.295155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4798a3-fb91-4787-8153-67fd35326fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:39.296840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1f4798a3-fb91-4787-8153-67fd35326fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:39.408534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4798a3-fb91-4787-8153-67fd35326fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:39.410070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4798a3-fb91-4787-8153-67fd35326fa0 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:39.428380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 734/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:41.474206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea827-10b5-4454-9c31-fa08e38c9d48 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:41.474779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea827-10b5-4454-9c31-fa08e38c9d48 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:41.474779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ea827-10b5-4454-9c31-fa08e38c9d48 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:41.476867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:41.484805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670de0-2f2d-48d2-9656-6410544f179f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:41.485285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670de0-2f2d-48d2-9656-6410544f179f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:41.485385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670de0-2f2d-48d2-9656-6410544f179f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:41.555828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a1670de0-2f2d-48d2-9656-6410544f179f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:41.557046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a1670de0-2f2d-48d2-9656-6410544f179f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:41.596110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:41.655899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:14:41.697042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ea827-10b5-4454-9c31-fa08e38c9d48 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:41.698679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bd0ea827-10b5-4454-9c31-fa08e38c9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:41.807328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ea827-10b5-4454-9c31-fa08e38c9d48 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:41.845807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:41.884602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3692f94-63e2-4b9e-9472-e28cab99e8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:41.885223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3692f94-63e2-4b9e-9472-e28cab99e8fd service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:41.885495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3692f94-63e2-4b9e-9472-e28cab99e8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:41.885756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3692f94-63e2-4b9e-9472-e28cab99e8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:41.887404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3692f94-63e2-4b9e-9472-e28cab99e8fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:41.999079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3692f94-63e2-4b9e-9472-e28cab99e8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:42.000564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3692f94-63e2-4b9e-9472-e28cab99e8fd service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:42.020122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 729/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:44.020663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea55c7-dbb4-4ccd-b233-438b6df71d9e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:44.021235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea55c7-dbb4-4ccd-b233-438b6df71d9e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:44.021235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea55c7-dbb4-4ccd-b233-438b6df71d9e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:44.022662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:44.029094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf6cb-01e3-4f28-aabc-eb4f8abe18dd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:44.029562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf6cb-01e3-4f28-aabc-eb4f8abe18dd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:44.029662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbf6cb-01e3-4f28-aabc-eb4f8abe18dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:44.103651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dedbf6cb-01e3-4f28-aabc-eb4f8abe18dd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:44.104849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dedbf6cb-01e3-4f28-aabc-eb4f8abe18dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:44.125780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:44.219755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:44.259331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea55c7-dbb4-4ccd-b233-438b6df71d9e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:44.260860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b5ea55c7-dbb4-4ccd-b233-438b6df71d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:44.369587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea55c7-dbb4-4ccd-b233-438b6df71d9e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:44.439185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:44.446409 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb0dc9-5d1c-4c31-8885-aa30e6dbdbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:44.447056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb0dc9-5d1c-4c31-8885-aa30e6dbdbca service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:44.447325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb0dc9-5d1c-4c31-8885-aa30e6dbdbca service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:44.447594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb0dc9-5d1c-4c31-8885-aa30e6dbdbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:44.449212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fecb0dc9-5d1c-4c31-8885-aa30e6dbdbca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:44.566628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb0dc9-5d1c-4c31-8885-aa30e6dbdbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:44.568068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecb0dc9-5d1c-4c31-8885-aa30e6dbdbca service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:44.602429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 737/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:46.575331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715e3f-dfae-446c-8000-57aadf87e432 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:46.575839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715e3f-dfae-446c-8000-57aadf87e432 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:46.575839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b715e3f-dfae-446c-8000-57aadf87e432 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:46.577227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:14:46.583842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0621-6802-4253-b74b-2ebc75026864 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:46.584583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0621-6802-4253-b74b-2ebc75026864 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:46.584726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0621-6802-4253-b74b-2ebc75026864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:46.654630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-635e0621-6802-4253-b74b-2ebc75026864 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:14:46.655868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-635e0621-6802-4253-b74b-2ebc75026864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:46.717160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:46.766714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:14:46.809327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b715e3f-dfae-446c-8000-57aadf87e432 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:14:46.810955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6b715e3f-dfae-446c-8000-57aadf87e432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:46.918442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b715e3f-dfae-446c-8000-57aadf87e432 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:14:46.969274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:47.001900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd339-fad4-45c8-9561-002fe8a2fe6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:14:47.002556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd339-fad4-45c8-9561-002fe8a2fe6d service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:14:47.002835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd339-fad4-45c8-9561-002fe8a2fe6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:14:47.003108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd339-fad4-45c8-9561-002fe8a2fe6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:14:47.004729 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a87dd339-fad4-45c8-9561-002fe8a2fe6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:14:47.117995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dd339-fad4-45c8-9561-002fe8a2fe6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:14:47.120037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87dd339-fad4-45c8-9561-002fe8a2fe6d service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:14:47.140971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 732/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:14:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:14:56.764911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=22 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:14:57.138407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=66 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:06.388552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382d06-5133-419c-aa4f-6e34c10909aa None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:06.389082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382d06-5133-419c-aa4f-6e34c10909aa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:06.389082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f382d06-5133-419c-aa4f-6e34c10909aa None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:06.391381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 739/1471] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:15:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:15:06.399439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a2422-92e7-4043-8b91-e32bc31eb520 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:06.399913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a2422-92e7-4043-8b91-e32bc31eb520 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:06.400016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a2422-92e7-4043-8b91-e32bc31eb520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:06.467753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-061a2422-92e7-4043-8b91-e32bc31eb520 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:06.469003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-061a2422-92e7-4043-8b91-e32bc31eb520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:06.568420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 733/1472] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:15:06.669241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961fc02-e52e-4472-a875-1a7e3c349c8f None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:06.669529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961fc02-e52e-4472-a875-1a7e3c349c8f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:06.669810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961fc02-e52e-4472-a875-1a7e3c349c8f None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:06.671232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 740/1473] 10.222.0.17 () {54 vars in 966 bytes} [Sat Aug 6 01:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:15:06.676226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3448-6b0a-4332-bb4c-cd35eb2d1056 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:06.676485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3448-6b0a-4332-bb4c-cd35eb2d1056 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:06.676751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3448-6b0a-4332-bb4c-cd35eb2d1056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:06.755701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-267c3448-6b0a-4332-bb4c-cd35eb2d1056 None None] MFA Rules not processed for user `0131e4a3492c42c492c47a715a2bccaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:06.756965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-267c3448-6b0a-4332-bb4c-cd35eb2d1056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:06.778227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:06.834621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 734/1474] 10.222.0.17 () {58 vars in 1063 bytes} [Sat Aug 6 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:15:06.842562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961fc02-e52e-4472-a875-1a7e3c349c8f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:15:06.844166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3961fc02-e52e-4472-a875-1a7e3c349c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:06.955295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961fc02-e52e-4472-a875-1a7e3c349c8f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:15:07.033251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2e48-5755-4d4b-ad9b-de0c0f4dcf07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:15:07.033961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2e48-5755-4d4b-ad9b-de0c0f4dcf07 service glance] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:07.034230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2e48-5755-4d4b-ad9b-de0c0f4dcf07 service glance] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:07.034534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2e48-5755-4d4b-ad9b-de0c0f4dcf07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:07.036196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-207a2e48-5755-4d4b-ad9b-de0c0f4dcf07 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:07.096967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:07.155859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2e48-5755-4d4b-ad9b-de0c0f4dcf07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:15:07.157317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2e48-5755-4d4b-ad9b-de0c0f4dcf07 service glance] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:15:07.177343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 741/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:15:09.260284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0a4e-de43-43eb-9d88-60e9b44f4602 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:09.260921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0a4e-de43-43eb-9d88-60e9b44f4602 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:09.260921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a0a4e-de43-43eb-9d88-60e9b44f4602 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:09.263201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 735/1476] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:15:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:15:09.268712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e0eb-47cb-4289-8088-0c27de8eeeb9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:09.269156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e0eb-47cb-4289-8088-0c27de8eeeb9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:09.269277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870e0eb-47cb-4289-8088-0c27de8eeeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:09.337387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c870e0eb-47cb-4289-8088-0c27de8eeeb9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:09.338640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c870e0eb-47cb-4289-8088-0c27de8eeeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:09.436968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 742/1477] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:15:09.465521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a0a4e-de43-43eb-9d88-60e9b44f4602 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:15:09.467943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-da8a0a4e-de43-43eb-9d88-60e9b44f4602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:09.603363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a0a4e-de43-43eb-9d88-60e9b44f4602 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:15:09.658604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:09.707367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada28510-4a68-4b30-b377-91fd7eff2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:15:09.708024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28510-4a68-4b30-b377-91fd7eff2c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:09.708312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28510-4a68-4b30-b377-91fd7eff2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:09.708574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada28510-4a68-4b30-b377-91fd7eff2c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:09.709281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada28510-4a68-4b30-b377-91fd7eff2c8c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:15:09.711080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-ada28510-4a68-4b30-b377-91fd7eff2c8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:15:09.711080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:15:09.711080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:15:09.712249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada28510-4a68-4b30-b377-91fd7eff2c8c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:15:09.730974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 736/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Sat Aug 6 01:15:09 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:15:11.726681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28386fa-1066-43a2-b70a-df12f5229ba1 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:11.727279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28386fa-1066-43a2-b70a-df12f5229ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:11.727279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28386fa-1066-43a2-b70a-df12f5229ba1 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:11.728616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 743/1479] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:15:11.735264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da503b0-7ef2-4df9-b518-2512116a5fd0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:11.735938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da503b0-7ef2-4df9-b518-2512116a5fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:11.736137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da503b0-7ef2-4df9-b518-2512116a5fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:11.813789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0da503b0-7ef2-4df9-b518-2512116a5fd0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:11.814943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0da503b0-7ef2-4df9-b518-2512116a5fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:11.913713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 737/1480] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:15:11.958459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28386fa-1066-43a2-b70a-df12f5229ba1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:15:11.960236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b28386fa-1066-43a2-b70a-df12f5229ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:11.971155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:12.124244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28386fa-1066-43a2-b70a-df12f5229ba1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:15:12.210821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:12.244139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4bcee-2456-4866-9706-2fc2a8d4ffe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:15:12.244760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4bcee-2456-4866-9706-2fc2a8d4ffe2 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:12.245032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4bcee-2456-4866-9706-2fc2a8d4ffe2 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:12.245298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4bcee-2456-4866-9706-2fc2a8d4ffe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:12.247012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dea4bcee-2456-4866-9706-2fc2a8d4ffe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:12.346475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4bcee-2456-4866-9706-2fc2a8d4ffe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:15:12.348077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4bcee-2456-4866-9706-2fc2a8d4ffe2 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:15:12.367394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 744/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:15:14.543240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3c7e1-93a2-427c-8fa5-f63a7619d995 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:14.543786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3c7e1-93a2-427c-8fa5-f63a7619d995 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:14.543786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3c7e1-93a2-427c-8fa5-f63a7619d995 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:14.545220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 738/1482] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:15:14.550649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473ac81-0f11-4210-a59d-69a847bf3640 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:14.551081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473ac81-0f11-4210-a59d-69a847bf3640 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:14.551192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473ac81-0f11-4210-a59d-69a847bf3640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:14.621999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f473ac81-0f11-4210-a59d-69a847bf3640 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:14.622961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f473ac81-0f11-4210-a59d-69a847bf3640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:14.674878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:14.729441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 745/1483] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:15:14.765801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3c7e1-93a2-427c-8fa5-f63a7619d995 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:15:14.767415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-32d3c7e1-93a2-427c-8fa5-f63a7619d995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:14.794937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:14.882223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3c7e1-93a2-427c-8fa5-f63a7619d995 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:15:14.959387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74b2fa-6197-4803-9179-b949285eac73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:15:14.960002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b2fa-6197-4803-9179-b949285eac73 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:14.960273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b2fa-6197-4803-9179-b949285eac73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:14.960537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74b2fa-6197-4803-9179-b949285eac73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:14.962168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4f74b2fa-6197-4803-9179-b949285eac73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:15.047704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:15.084039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74b2fa-6197-4803-9179-b949285eac73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:15:15.085542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74b2fa-6197-4803-9179-b949285eac73 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:15:15.103514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 739/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:15:17.118918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942d6b-5d58-4440-b5da-a1335ef3d46b None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:17.119523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942d6b-5d58-4440-b5da-a1335ef3d46b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:17.119523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44942d6b-5d58-4440-b5da-a1335ef3d46b None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:17.120838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 746/1485] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:15:17.127379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373bc6-68de-4c84-8b05-528c2c77980a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:17.128115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373bc6-68de-4c84-8b05-528c2c77980a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:17.128265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8373bc6-68de-4c84-8b05-528c2c77980a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:17.199657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d8373bc6-68de-4c84-8b05-528c2c77980a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:17.200911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8373bc6-68de-4c84-8b05-528c2c77980a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:17.299266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 740/1486] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:15:17.341072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942d6b-5d58-4440-b5da-a1335ef3d46b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:15:17.342650 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-44942d6b-5d58-4440-b5da-a1335ef3d46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:17.450613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44942d6b-5d58-4440-b5da-a1335ef3d46b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:15:17.530277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:17.532048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587b8fa-887e-41f6-9b2e-7241b4b20311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:15:17.532732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587b8fa-887e-41f6-9b2e-7241b4b20311 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:17.533055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587b8fa-887e-41f6-9b2e-7241b4b20311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:17.533384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587b8fa-887e-41f6-9b2e-7241b4b20311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:17.535811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2587b8fa-887e-41f6-9b2e-7241b4b20311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:17.650959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587b8fa-887e-41f6-9b2e-7241b4b20311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:15:17.652416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587b8fa-887e-41f6-9b2e-7241b4b20311 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:15:17.671485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 747/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:15:19.835374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50b8e-ed44-49b4-a8a9-65227e4f12bb None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:19.835949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50b8e-ed44-49b4-a8a9-65227e4f12bb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:19.835949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50b8e-ed44-49b4-a8a9-65227e4f12bb None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:19.837178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 741/1488] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:15:19.842821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021f56a-df5f-4b07-a57a-009e979f9fd5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:19.843287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021f56a-df5f-4b07-a57a-009e979f9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:19.843406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021f56a-df5f-4b07-a57a-009e979f9fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:19.911992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2021f56a-df5f-4b07-a57a-009e979f9fd5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:19.913188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2021f56a-df5f-4b07-a57a-009e979f9fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:19.969682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:20.015129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 748/1489] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:15:20.056605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50b8e-ed44-49b4-a8a9-65227e4f12bb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:15:20.059142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f6c50b8e-ed44-49b4-a8a9-65227e4f12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:20.103380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:20.188670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50b8e-ed44-49b4-a8a9-65227e4f12bb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:15:20.268983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b179082e-2bf4-4c6e-871a-b946b07837a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:15:20.269644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179082e-2bf4-4c6e-871a-b946b07837a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:20.269921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179082e-2bf4-4c6e-871a-b946b07837a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:20.270226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b179082e-2bf4-4c6e-871a-b946b07837a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:20.271872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b179082e-2bf4-4c6e-871a-b946b07837a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:20.356687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:20.388775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179082e-2bf4-4c6e-871a-b946b07837a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:15:20.390316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b179082e-2bf4-4c6e-871a-b946b07837a9 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:15:20.411068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 742/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:15:22.645680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894eb53-11ec-49f1-981c-4c72e9c27b12 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:22.646222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894eb53-11ec-49f1-981c-4c72e9c27b12 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:22.646325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894eb53-11ec-49f1-981c-4c72e9c27b12 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:22.648451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 749/1491] 10.222.0.17 () {54 vars in 927 bytes} [Sat Aug 6 01:15:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:15:22.655605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a66a-bf7a-4150-a830-f068c9ae8fab None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:22.656010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a66a-bf7a-4150-a830-f068c9ae8fab None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:22.656188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21a66a-bf7a-4150-a830-f068c9ae8fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:22.722988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed21a66a-bf7a-4150-a830-f068c9ae8fab None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:15:22.724199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed21a66a-bf7a-4150-a830-f068c9ae8fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:22.824039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 743/1492] 10.222.0.17 () {58 vars in 1024 bytes} [Sat Aug 6 01:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:15:22.864112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894eb53-11ec-49f1-981c-4c72e9c27b12 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:15:22.865651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5894eb53-11ec-49f1-981c-4c72e9c27b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:22.976768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894eb53-11ec-49f1-981c-4c72e9c27b12 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:15:23.060488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4b059-1e20-4730-9122-09154bc0bf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:15:23.061121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4b059-1e20-4730-9122-09154bc0bf89 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:15:23.061402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4b059-1e20-4730-9122-09154bc0bf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:15:23.061673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4b059-1e20-4730-9122-09154bc0bf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:15:23.063340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2eb4b059-1e20-4730-9122-09154bc0bf89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:15:23.072531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:23.179311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4b059-1e20-4730-9122-09154bc0bf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:15:23.180758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4b059-1e20-4730-9122-09154bc0bf89 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:15:23.204176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 750/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:15:32.822160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=82 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:15:33.201613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=50 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:01.575478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:01.576257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:01.576257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:01.665219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:17:01.666489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:01.766925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 744/1494] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:17:01.779061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da0a26-f37d-4798-ba7e-e2d0b98224ae None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:01.779582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da0a26-f37d-4798-ba7e-e2d0b98224ae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:01.779582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da0a26-f37d-4798-ba7e-e2d0b98224ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:01.859302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a2da0a26-f37d-4798-ba7e-e2d0b98224ae None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:17:01.860525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a2da0a26-f37d-4798-ba7e-e2d0b98224ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:01.987311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 751/1495] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:17:01.992211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:01.993422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:02.005100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728949d9-4f0d-4599-8f54-831d020edf9f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:02.068204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:02.103517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:02.104143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:02.104422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:02.104695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:02.105389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:17:02.105693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:02.106821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:02.106821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:17:02.106821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:17:02.107697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:02.118953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 745/1496] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:17:02.128107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da0a26-f37d-4798-ba7e-e2d0b98224ae None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:02.140812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da0a26-f37d-4798-ba7e-e2d0b98224ae None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:02.204250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:02.238536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:02.239150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:02.239423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:02.239690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:02.240346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:02.242118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:02.242118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: warnings.warn(msg) Aug 06 01:17:02.242118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: Aug 06 01:17:02.243313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:02.300617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 752/1497] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:17:02 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:17:02.305170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:02.306737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:02.343035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308fb97-e014-4838-b321-79eb2d8057ec admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:02.438450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bd245-a568-4936-9747-84811c520713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:02.439084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bd245-a568-4936-9747-84811c520713 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:02.439362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bd245-a568-4936-9747-84811c520713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:02.439634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bd245-a568-4936-9747-84811c520713 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:02.440289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bd245-a568-4936-9747-84811c520713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:02.441325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-685bd245-a568-4936-9747-84811c520713 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:02.441325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:17:02.441325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:17:02.442572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bd245-a568-4936-9747-84811c520713 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:02.494455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 746/1498] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:17:02 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:17:02.499102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:02.500670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:02.576028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2437989e-bbe7-459c-a67f-365316fbcf62 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:02.665165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:02.678637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:02.679257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:02.679534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:02.679839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:02.680548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:02.681567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:02.681567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: warnings.warn(msg) Aug 06 01:17:02.681567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: Aug 06 01:17:02.682515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:02.695443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 753/1499] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:17:02.699718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bd245-a568-4936-9747-84811c520713 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:02.701293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-685bd245-a568-4936-9747-84811c520713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:02.713041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bd245-a568-4936-9747-84811c520713 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:02.739494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:02.812575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078ea5e-2587-43a9-8f15-ebc2f726b3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:02.813231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078ea5e-2587-43a9-8f15-ebc2f726b3de admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:02.813510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078ea5e-2587-43a9-8f15-ebc2f726b3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:02.813780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078ea5e-2587-43a9-8f15-ebc2f726b3de admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:02.814514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078ea5e-2587-43a9-8f15-ebc2f726b3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:02.815569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-1078ea5e-2587-43a9-8f15-ebc2f726b3de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:02.815569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:17:02.815569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:17:02.816471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078ea5e-2587-43a9-8f15-ebc2f726b3de admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:02.829381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 747/1500] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:17:02.834358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:02.836473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:02.878731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8796-73ee-460f-87bd-534ba1eb7411 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:02.989059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86912091-08ad-4779-999d-179791615fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:02.989768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86912091-08ad-4779-999d-179791615fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:02.990087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86912091-08ad-4779-999d-179791615fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:02.990366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86912091-08ad-4779-999d-179791615fae admin admin] PATH_INFO: `/v3/projects/1f82ff47c82b4effad0ebe08c294b400/users/5fa0009c057445d2a79c6788175aa234/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:03.017508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86912091-08ad-4779-999d-179791615fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f82ff47c82b4effad0ebe08c294b400, user_id=5fa0009c057445d2a79c6788175aa234, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:03.018591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-86912091-08ad-4779-999d-179791615fae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:03.018591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: warnings.warn(msg) Aug 06 01:17:03.018591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: Aug 06 01:17:03.020527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86912091-08ad-4779-999d-179791615fae admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:03.049071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 754/1501] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:17:02 2022] PUT /identity/v3/projects/1f82ff47c82b4effad0ebe08c294b400/users/5fa0009c057445d2a79c6788175aa234/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:17:03.062076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0374-7b38-4585-87ff-2238328c9420 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:03.062373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0374-7b38-4585-87ff-2238328c9420 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:03.062660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f0374-7b38-4585-87ff-2238328c9420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:03.121142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8b3f0374-7b38-4585-87ff-2238328c9420 None None] MFA Rules not processed for user `5fa0009c057445d2a79c6788175aa234`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:17:03.122515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8b3f0374-7b38-4585-87ff-2238328c9420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:03.199786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 748/1502] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:17:03.213755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048536f-ba8d-420a-8592-31393ac608c3 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:03.214067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048536f-ba8d-420a-8592-31393ac608c3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:03.214339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048536f-ba8d-420a-8592-31393ac608c3 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:03.215851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 755/1503] 10.222.0.17 () {54 vars in 964 bytes} [Sat Aug 6 01:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:17:03.220913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c451ec-b027-4dec-9654-ed1d5df8e51b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:03.221207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c451ec-b027-4dec-9654-ed1d5df8e51b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:03.221482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c451ec-b027-4dec-9654-ed1d5df8e51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:03.252645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:03.306279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-27c451ec-b027-4dec-9654-ed1d5df8e51b None None] MFA Rules not processed for user `b52057428b6444fbbb5d182ab8a2c80a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:17:03.307501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27c451ec-b027-4dec-9654-ed1d5df8e51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:03.404198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 749/1504] 10.222.0.17 () {58 vars in 1061 bytes} [Sat Aug 6 01:17:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:17:03.416212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048536f-ba8d-420a-8592-31393ac608c3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:03.418514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7048536f-ba8d-420a-8592-31393ac608c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:03.472521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:03.534194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048536f-ba8d-420a-8592-31393ac608c3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:03.608757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:03.609387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:03.609655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:03.610055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:03.611685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:03.714260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:03.715794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:03.719319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:03.735215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 756/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:17:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:17:03.781108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3c78-6710-4820-9054-fe6ac482ccfc None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:03.781545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3c78-6710-4820-9054-fe6ac482ccfc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:03.781653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed3c78-6710-4820-9054-fe6ac482ccfc None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:03.783022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 750/1506] 10.222.0.17 () {52 vars in 830 bytes} [Sat Aug 6 01:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:17:03.786710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:03.787926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:03.893168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d18893-1f0e-4166-9cb3-0da691f5fe4c service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:03.997418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:03.998108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:03.998401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:03.998675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] PATH_INFO: `/v3/users/5fa0009c057445d2a79c6788175aa234` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:04.012551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa0009c057445d2a79c6788175aa234)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:04.013533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:04.013533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: warnings.warn(msg) Aug 06 01:17:04.013533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: Aug 06 01:17:04.014807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:04.025198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:04.098943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa0009c057445d2a79c6788175aa234'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:04.109908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa0009c057445d2a79c6788175aa234'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:04.134056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa0009c057445d2a79c6788175aa234'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:04.134591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa0009c057445d2a79c6788175aa234'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:04.148771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa0009c057445d2a79c6788175aa234'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:04.154463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 757/1507] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:17:03 2022] DELETE /identity/v3/users/5fa0009c057445d2a79c6788175aa234 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:17:04.159088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:04.159375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:04.159647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:04.218844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:17:04.220059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:04.297630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:04.311826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 751/1508] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:17:04.323124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:04.324372 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:04.428758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7307f45-e2de-4bb3-8d2b-e53ebdb9f2fc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:04.489258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:04.512068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25574a36-1f9f-4b89-99cd-bc9b63467470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:04.512707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25574a36-1f9f-4b89-99cd-bc9b63467470 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:04.512985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25574a36-1f9f-4b89-99cd-bc9b63467470 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:04.513257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25574a36-1f9f-4b89-99cd-bc9b63467470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:04.514972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-25574a36-1f9f-4b89-99cd-bc9b63467470 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:04.633713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25574a36-1f9f-4b89-99cd-bc9b63467470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:04.635155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25574a36-1f9f-4b89-99cd-bc9b63467470 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:04.654431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 758/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:17:05.080520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:17:05.081805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:17:05.093346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43653-af64-42d3-9fa2-670dc7bb7f03 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:17:05.189783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:17:05.190462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:17:05.190718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:17:05.191023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] PATH_INFO: `/v3/projects/1f82ff47c82b4effad0ebe08c294b400` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:17:05.202132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f82ff47c82b4effad0ebe08c294b400)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:17:05.203121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:17:05.203121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:17:05.203121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:17:05.204323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:17:05.263123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f82ff47c82b4effad0ebe08c294b400', 'request_id': 'req-914ea759-6c04-45aa-b076-151f58f50881'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:05.272796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f82ff47c82b4effad0ebe08c294b400', 'request_id': 'req-914ea759-6c04-45aa-b076-151f58f50881'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:05.278981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f82ff47c82b4effad0ebe08c294b400', 'request_id': 'req-914ea759-6c04-45aa-b076-151f58f50881'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:05.311593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] The token cache is being invalidate because project 1f82ff47c82b4effad0ebe08c294b400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:17:05.311874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:05.312387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-914ea759-6c04-45aa-b076-151f58f50881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:17:05.313738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 752/1510] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:17:05 2022] DELETE /identity/v3/projects/1f82ff47c82b4effad0ebe08c294b400 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:17:14.651546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=62 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:17:15.309251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:18:37.261199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1573c9-42ca-41ef-85cf-43ac3ce5dcf4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:37.261765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1573c9-42ca-41ef-85cf-43ac3ce5dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:37.261765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1573c9-42ca-41ef-85cf-43ac3ce5dcf4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:37.263155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:18:37.268598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3989-a44e-4c09-aa83-3f8a414488d3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:37.269323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3989-a44e-4c09-aa83-3f8a414488d3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:37.269581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3989-a44e-4c09-aa83-3f8a414488d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:37.355341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-675f3989-a44e-4c09-aa83-3f8a414488d3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:37.356545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-675f3989-a44e-4c09-aa83-3f8a414488d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:37.464082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:18:37.619968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1573c9-42ca-41ef-85cf-43ac3ce5dcf4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:18:37.622633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fd1573c9-42ca-41ef-85cf-43ac3ce5dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:37.755675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1573c9-42ca-41ef-85cf-43ac3ce5dcf4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:18:37.761804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3656e9-4b2e-467f-b663-5f060c641332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:18:37.762396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3656e9-4b2e-467f-b663-5f060c641332 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:37.762672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3656e9-4b2e-467f-b663-5f060c641332 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:37.762947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3656e9-4b2e-467f-b663-5f060c641332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:37.771135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3656e9-4b2e-467f-b663-5f060c641332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:18:37.772729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3656e9-4b2e-467f-b663-5f060c641332 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:18:37.782270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 760/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:18:38.603324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf7cd9-4d77-4094-9e00-29f2b8725141 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:38.603881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf7cd9-4d77-4094-9e00-29f2b8725141 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:38.603881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf7cd9-4d77-4094-9e00-29f2b8725141 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:38.605257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:18:38.611225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e64e-7e19-4595-bed8-f804c081bda3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:38.611953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e64e-7e19-4595-bed8-f804c081bda3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:38.612136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384e64e-7e19-4595-bed8-f804c081bda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:38.634971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0384e64e-7e19-4595-bed8-f804c081bda3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:38.636196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0384e64e-7e19-4595-bed8-f804c081bda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:38.645081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:18:38.796753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf7cd9-4d77-4094-9e00-29f2b8725141 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:18:38.812267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf7cd9-4d77-4094-9e00-29f2b8725141 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:18:38.818156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc6da1-1c58-4296-9dba-97c57487c5cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:18:38.818764 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc6da1-1c58-4296-9dba-97c57487c5cc service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:38.819040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc6da1-1c58-4296-9dba-97c57487c5cc service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:38.819330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc6da1-1c58-4296-9dba-97c57487c5cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:38.827591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc6da1-1c58-4296-9dba-97c57487c5cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:18:38.829296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc6da1-1c58-4296-9dba-97c57487c5cc service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:18:38.838824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 755/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:18:39.153057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de5e-6e5a-4c86-a9d2-62097388de17 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:39.153283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de5e-6e5a-4c86-a9d2-62097388de17 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:39.153513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de5e-6e5a-4c86-a9d2-62097388de17 None None] PATH_INFO: `/v3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:39.154924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 762/1517] 10.222.0.30 () {54 vars in 925 bytes} [Sat Aug 6 01:18:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:18:39.163311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a367-9719-41e3-bf06-79b1e5b6f9ac None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:39.163592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a367-9719-41e3-bf06-79b1e5b6f9ac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:39.163862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9a367-9719-41e3-bf06-79b1e5b6f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:39.226693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-83a9a367-9719-41e3-bf06-79b1e5b6f9ac None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:39.227883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-83a9a367-9719-41e3-bf06-79b1e5b6f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:39.245379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:18:39.303668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 756/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Aug 6 01:18:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:18:48.483029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452d1e-6c46-4cb4-b87a-e70885d07e73 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:48.483619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452d1e-6c46-4cb4-b87a-e70885d07e73 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:48.483619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452d1e-6c46-4cb4-b87a-e70885d07e73 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:48.484861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 763/1519] 10.222.0.17 () {54 vars in 961 bytes} [Sat Aug 6 01:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:18:48.490946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129515-cf02-4b20-9968-f060efc06e52 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:48.491407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129515-cf02-4b20-9968-f060efc06e52 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:48.491515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3129515-cf02-4b20-9968-f060efc06e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:48.514634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e3129515-cf02-4b20-9968-f060efc06e52 None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:48.515863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e3129515-cf02-4b20-9968-f060efc06e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:48.526789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 757/1520] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Aug 6 01:18:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:18:48.534566 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3452d1e-6c46-4cb4-b87a-e70885d07e73 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:18:48.548716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3452d1e-6c46-4cb4-b87a-e70885d07e73 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:18:48.554221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150187-5b69-4b18-b4bc-73af95f32cab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:18:48.554830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150187-5b69-4b18-b4bc-73af95f32cab service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:48.555183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150187-5b69-4b18-b4bc-73af95f32cab service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:48.555459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150187-5b69-4b18-b4bc-73af95f32cab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:48.563753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150187-5b69-4b18-b4bc-73af95f32cab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:18:48.565333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff150187-5b69-4b18-b4bc-73af95f32cab service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:18:48.575025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 764/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:18:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:18:50.077886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f760c0-9eaa-40f5-a74a-4747a976de87 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:50.078773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f760c0-9eaa-40f5-a74a-4747a976de87 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:50.078773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f760c0-9eaa-40f5-a74a-4747a976de87 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:50.081064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:18:50.086909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199d38-6c30-42a3-b6b1-9ea54a34d12a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:50.087356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199d38-6c30-42a3-b6b1-9ea54a34d12a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:50.087469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a199d38-6c30-42a3-b6b1-9ea54a34d12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:50.107446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6a199d38-6c30-42a3-b6b1-9ea54a34d12a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:50.108657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6a199d38-6c30-42a3-b6b1-9ea54a34d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:50.117179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:18:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:18:50.276583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f760c0-9eaa-40f5-a74a-4747a976de87 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:18:50.297802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f760c0-9eaa-40f5-a74a-4747a976de87 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:18:50.304313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23c55-f9c2-4426-8364-aeae1b7846c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:18:50.304932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23c55-f9c2-4426-8364-aeae1b7846c9 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:50.305215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23c55-f9c2-4426-8364-aeae1b7846c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:50.305490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23c55-f9c2-4426-8364-aeae1b7846c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:50.314931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23c55-f9c2-4426-8364-aeae1b7846c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:18:50.316555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23c55-f9c2-4426-8364-aeae1b7846c9 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:18:50.326357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 759/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:18:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:18:51.150048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ec4d3-76f5-4b37-a2d9-b1de2aba30c4 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:51.150599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ec4d3-76f5-4b37-a2d9-b1de2aba30c4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:51.150599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ec4d3-76f5-4b37-a2d9-b1de2aba30c4 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:51.152684 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 6 01:18:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:18:51.160933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a7584-ca30-4a75-8261-15520e02be22 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:51.161338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a7584-ca30-4a75-8261-15520e02be22 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:51.161537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a7584-ca30-4a75-8261-15520e02be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:51.182976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-196a7584-ca30-4a75-8261-15520e02be22 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:51.184188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-196a7584-ca30-4a75-8261-15520e02be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:51.193471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 6 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:18:51.344731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ec4d3-76f5-4b37-a2d9-b1de2aba30c4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:18:51.360010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ec4d3-76f5-4b37-a2d9-b1de2aba30c4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:18:51.365752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ee86-e85b-4c59-8025-8ae0156ce41a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:18:51.366398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ee86-e85b-4c59-8025-8ae0156ce41a service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:51.366673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ee86-e85b-4c59-8025-8ae0156ce41a service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:51.366948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ee86-e85b-4c59-8025-8ae0156ce41a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:51.375316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96ee86-e85b-4c59-8025-8ae0156ce41a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:18:51.376916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96ee86-e85b-4c59-8025-8ae0156ce41a service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:18:51.386606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 767/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:18:55.218666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c08fa7-fc68-40d0-8269-f70f7775bf37 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:55.219296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c08fa7-fc68-40d0-8269-f70f7775bf37 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:55.219296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c08fa7-fc68-40d0-8269-f70f7775bf37 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:55.221304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:18:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:18:55.226852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43fe5-fe96-40d5-be97-18a08b1b4570 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:55.227305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43fe5-fe96-40d5-be97-18a08b1b4570 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:55.227407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba43fe5-fe96-40d5-be97-18a08b1b4570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:55.247773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0ba43fe5-fe96-40d5-be97-18a08b1b4570 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:55.248967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0ba43fe5-fe96-40d5-be97-18a08b1b4570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:55.257772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:18:55.333166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c08fa7-fc68-40d0-8269-f70f7775bf37 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:18:55.336440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-17c08fa7-fc68-40d0-8269-f70f7775bf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:55.419273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c08fa7-fc68-40d0-8269-f70f7775bf37 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:18:55.423211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658beb36-987b-4bee-a681-1f440f0d8d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:18:55.423834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658beb36-987b-4bee-a681-1f440f0d8d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:55.424114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658beb36-987b-4bee-a681-1f440f0d8d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:55.424385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658beb36-987b-4bee-a681-1f440f0d8d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:55.433710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658beb36-987b-4bee-a681-1f440f0d8d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:18:55.435195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658beb36-987b-4bee-a681-1f440f0d8d93 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:18:55.444564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 762/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:18:57.407796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c00e-13b7-43d0-8a84-27f77968dae1 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:57.408401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c00e-13b7-43d0-8a84-27f77968dae1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:57.408401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466c00e-13b7-43d0-8a84-27f77968dae1 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:57.409734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:18:57.416378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac9d49-caee-472e-8a90-12813cc5d275 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:57.417066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac9d49-caee-472e-8a90-12813cc5d275 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:57.417271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac9d49-caee-472e-8a90-12813cc5d275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:57.442826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cdac9d49-caee-472e-8a90-12813cc5d275 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:18:57.444065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cdac9d49-caee-472e-8a90-12813cc5d275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:57.452691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:18:57.489597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c00e-13b7-43d0-8a84-27f77968dae1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:18:57.492011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1466c00e-13b7-43d0-8a84-27f77968dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:18:57.506969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466c00e-13b7-43d0-8a84-27f77968dae1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:18:57.510702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac57b63-0c2c-4abc-bc2a-07cb5065277d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:18:57.511320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57b63-0c2c-4abc-bc2a-07cb5065277d service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:18:57.512907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57b63-0c2c-4abc-bc2a-07cb5065277d service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:18:57.513190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac57b63-0c2c-4abc-bc2a-07cb5065277d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:18:57.522656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac57b63-0c2c-4abc-bc2a-07cb5065277d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:18:57.524346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac57b63-0c2c-4abc-bc2a-07cb5065277d service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:18:57.534047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 770/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:19:00.936319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518c8b-7456-4a06-93b1-9d7a68c7126e None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:00.936962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518c8b-7456-4a06-93b1-9d7a68c7126e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:00.936962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4518c8b-7456-4a06-93b1-9d7a68c7126e None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:00.938268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:00.944631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa5a7f-1fbf-4001-bfcb-7a13677eae6e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:00.945480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa5a7f-1fbf-4001-bfcb-7a13677eae6e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:00.945589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa5a7f-1fbf-4001-bfcb-7a13677eae6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:00.966691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-79aa5a7f-1fbf-4001-bfcb-7a13677eae6e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:00.967902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-79aa5a7f-1fbf-4001-bfcb-7a13677eae6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:00.976032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:19:01.290269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4518c8b-7456-4a06-93b1-9d7a68c7126e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:01.292410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f4518c8b-7456-4a06-93b1-9d7a68c7126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:01.365867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:01.381039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4518c8b-7456-4a06-93b1-9d7a68c7126e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:01.384972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed472aad-a678-4127-b815-2e1d27c6e9e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:01.385588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472aad-a678-4127-b815-2e1d27c6e9e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:01.385864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472aad-a678-4127-b815-2e1d27c6e9e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:01.386162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed472aad-a678-4127-b815-2e1d27c6e9e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:01.395167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed472aad-a678-4127-b815-2e1d27c6e9e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:01.396619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed472aad-a678-4127-b815-2e1d27c6e9e1 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:01.405960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 765/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:19:03.387763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031da2c-d63e-4fe8-bcb3-415321f71db2 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:03.388664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031da2c-d63e-4fe8-bcb3-415321f71db2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:03.389100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031da2c-d63e-4fe8-bcb3-415321f71db2 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:03.390673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 6 01:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:19:03.396040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e072e-e235-48b7-801e-cf7828ce51d8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:03.396485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e072e-e235-48b7-801e-cf7828ce51d8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:03.396595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e072e-e235-48b7-801e-cf7828ce51d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:03.418149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-399e072e-e235-48b7-801e-cf7828ce51d8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:19:03.419386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-399e072e-e235-48b7-801e-cf7828ce51d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:03.428070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 6 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:19:03.734104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031da2c-d63e-4fe8-bcb3-415321f71db2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:19:03.736161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3031da2c-d63e-4fe8-bcb3-415321f71db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:19:03.751415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031da2c-d63e-4fe8-bcb3-415321f71db2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:19:03.756264 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f78ff3-099b-480f-8c8d-46ec4333a116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:19:03.756867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f78ff3-099b-480f-8c8d-46ec4333a116 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:19:03.757139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f78ff3-099b-480f-8c8d-46ec4333a116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:19:03.757406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f78ff3-099b-480f-8c8d-46ec4333a116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:19:03.766774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f78ff3-099b-480f-8c8d-46ec4333a116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:19:03.768184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f78ff3-099b-480f-8c8d-46ec4333a116 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:19:03.777602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 773/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:19:13.413243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=11 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:19:13.773632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:30.629119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2642d90-4e1e-497d-bed0-f161009583d6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.631045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2642d90-4e1e-497d-bed0-f161009583d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.631045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2642d90-4e1e-497d-bed0-f161009583d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.657290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f2642d90-4e1e-497d-bed0-f161009583d6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:30.659044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f2642d90-4e1e-497d-bed0-f161009583d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:30.672986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 767/1540] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:30.682683 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066bff-242b-4e25-8716-ec5c5df725f4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.683677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066bff-242b-4e25-8716-ec5c5df725f4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.684367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c066bff-242b-4e25-8716-ec5c5df725f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.709260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8c066bff-242b-4e25-8716-ec5c5df725f4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:30.711026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8c066bff-242b-4e25-8716-ec5c5df725f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:30.722805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 774/1541] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:30.728695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2642d90-4e1e-497d-bed0-f161009583d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.740379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2642d90-4e1e-497d-bed0-f161009583d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.745923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9985518-51f5-4a1f-9d9c-1dd71370a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.746965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985518-51f5-4a1f-9d9c-1dd71370a3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.747466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985518-51f5-4a1f-9d9c-1dd71370a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.748311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9985518-51f5-4a1f-9d9c-1dd71370a3ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.749233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9985518-51f5-4a1f-9d9c-1dd71370a3ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:30.749805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9985518-51f5-4a1f-9d9c-1dd71370a3ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.752455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9985518-51f5-4a1f-9d9c-1dd71370a3ce admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.770373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 768/1542] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:30.779951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066bff-242b-4e25-8716-ec5c5df725f4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.801892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c066bff-242b-4e25-8716-ec5c5df725f4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:30.804254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fac185-5cb6-4c1b-91d7-2c33854fb03c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.804775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fac185-5cb6-4c1b-91d7-2c33854fb03c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.805264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fac185-5cb6-4c1b-91d7-2c33854fb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.816433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:30.817371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.817727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.818205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.819195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:30.822511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:30.850507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d9fac185-5cb6-4c1b-91d7-2c33854fb03c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:30.851722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d9fac185-5cb6-4c1b-91d7-2c33854fb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:30.870068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 769/1543] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:30.874399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81688d-78d3-4b48-8deb-24ed1c66fc3a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.874682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81688d-78d3-4b48-8deb-24ed1c66fc3a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.874953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81688d-78d3-4b48-8deb-24ed1c66fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.902910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3e81688d-78d3-4b48-8deb-24ed1c66fc3a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:30.904138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3e81688d-78d3-4b48-8deb-24ed1c66fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:30.916982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 770/1544] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:30.918647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63478-a8b5-4afc-af48-7689bc8560c5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.919136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63478-a8b5-4afc-af48-7689bc8560c5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.919345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a63478-a8b5-4afc-af48-7689bc8560c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:30.945947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a1a63478-a8b5-4afc-af48-7689bc8560c5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:30.947158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a1a63478-a8b5-4afc-af48-7689bc8560c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:30.951743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 775/1545] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:30 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:30.952925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:30.968389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 771/1546] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:30.970108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5853-c192-445a-b868-11082ece7012 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:30.970757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5853-c192-445a-b868-11082ece7012 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:30.971248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec5853-c192-445a-b868-11082ece7012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.017105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c8ec5853-c192-445a-b868-11082ece7012 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.018848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8ec5853-c192-445a-b868-11082ece7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.083227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01c85b-8727-4eec-a556-fe8c979f0004 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.088842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.089531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.089791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.090092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.090936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.091260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.092437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:20:31.092437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: warnings.warn(msg) Aug 06 01:20:31.092437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: Aug 06 01:20:31.093533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ae2d5-9254-45a3-a3c4-482a94d6b2e1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.107176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 772/1547] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.108030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5853-c192-445a-b868-11082ece7012 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.110777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 776/1548] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.112352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088f3b6-aa4f-4473-bd75-248e1266b4a6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.112857 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088f3b6-aa4f-4473-bd75-248e1266b4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.113357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088f3b6-aa4f-4473-bd75-248e1266b4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.129208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec5853-c192-445a-b868-11082ece7012 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.133826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5088f3b6-aa4f-4473-bd75-248e1266b4a6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.134296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950aff0d-8f11-4976-9794-a11cb1e18251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.134934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aff0d-8f11-4976-9794-a11cb1e18251 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.135071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5088f3b6-aa4f-4473-bd75-248e1266b4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.135258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aff0d-8f11-4976-9794-a11cb1e18251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.135532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950aff0d-8f11-4976-9794-a11cb1e18251 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.136200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950aff0d-8f11-4976-9794-a11cb1e18251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.138200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950aff0d-8f11-4976-9794-a11cb1e18251 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.143417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 777/1549] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.148053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebfa8d-40ad-4e9a-bfc8-be18ccd64dd5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.148339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebfa8d-40ad-4e9a-bfc8-be18ccd64dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.148618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebfa8d-40ad-4e9a-bfc8-be18ccd64dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.164052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 773/1550] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/users => generated 284 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.165696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d0d0d-3fe5-42b2-8e24-213d4e1691a3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.166038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d0d0d-3fe5-42b2-8e24-213d4e1691a3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.166399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d0d0d-3fe5-42b2-8e24-213d4e1691a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.169104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-42ebfa8d-40ad-4e9a-bfc8-be18ccd64dd5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.170347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-42ebfa8d-40ad-4e9a-bfc8-be18ccd64dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.178875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 778/1551] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.187443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f032-63e5-4c64-aaf5-f48eb43966e5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.187634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-534d0d0d-3fe5-42b2-8e24-213d4e1691a3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.187743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f032-63e5-4c64-aaf5-f48eb43966e5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.187963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f032-63e5-4c64-aaf5-f48eb43966e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.192651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-534d0d0d-3fe5-42b2-8e24-213d4e1691a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.201710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 774/1552] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.203866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aae91-6bf4-46df-a1e0-243019dc96cf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.204159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aae91-6bf4-46df-a1e0-243019dc96cf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.204439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5aae91-6bf4-46df-a1e0-243019dc96cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.209137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1d56f032-63e5-4c64-aaf5-f48eb43966e5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.210694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1d56f032-63e5-4c64-aaf5-f48eb43966e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.220319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 779/1553] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.221103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f032-63e5-4c64-aaf5-f48eb43966e5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.224619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ed5aae91-6bf4-46df-a1e0-243019dc96cf None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.226039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ed5aae91-6bf4-46df-a1e0-243019dc96cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.230970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f032-63e5-4c64-aaf5-f48eb43966e5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.234806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 775/1554] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.235623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aae91-6bf4-46df-a1e0-243019dc96cf None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.236412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d066a-95ba-4f9c-9112-06a79ccf4af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.237104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d066a-95ba-4f9c-9112-06a79ccf4af0 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.237450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d066a-95ba-4f9c-9112-06a79ccf4af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.237786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d066a-95ba-4f9c-9112-06a79ccf4af0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.238553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d066a-95ba-4f9c-9112-06a79ccf4af0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.240546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d066a-95ba-4f9c-9112-06a79ccf4af0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.245252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5aae91-6bf4-46df-a1e0-243019dc96cf None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.250167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.250825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.251234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.251557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.252302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.252556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.254247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.269983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 776/1555] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.269983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.274219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 780/1556] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.275796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338993-def7-4c54-984e-5691d2c6f11d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.276258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338993-def7-4c54-984e-5691d2c6f11d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.276705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338993-def7-4c54-984e-5691d2c6f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.280720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12897e6-dc27-4774-8130-9e27cc05060a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.296288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-60338993-def7-4c54-984e-5691d2c6f11d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.297493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-60338993-def7-4c54-984e-5691d2c6f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.337896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50643e9-df2a-4e2e-a39e-f8404bf82a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.338511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50643e9-df2a-4e2e-a39e-f8404bf82a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.338797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50643e9-df2a-4e2e-a39e-f8404bf82a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.339074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50643e9-df2a-4e2e-a39e-f8404bf82a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.339775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50643e9-df2a-4e2e-a39e-f8404bf82a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.341416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50643e9-df2a-4e2e-a39e-f8404bf82a78 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.351921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 777/1557] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:31.353486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38b4e-1f3b-436d-ab93-2edd309f36aa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.353984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38b4e-1f3b-436d-ab93-2edd309f36aa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.354475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38b4e-1f3b-436d-ab93-2edd309f36aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.364864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 781/1558] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.367249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45c1f-ce07-438c-a494-6956d091069d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.367538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45c1f-ce07-438c-a494-6956d091069d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.367836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45c1f-ce07-438c-a494-6956d091069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.374897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9ae38b4e-1f3b-436d-ab93-2edd309f36aa None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.376105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9ae38b4e-1f3b-436d-ab93-2edd309f36aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.385402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 778/1559] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.386801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9cf20-0036-4dde-b00b-d38fa398d43b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.387145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9cf20-0036-4dde-b00b-d38fa398d43b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.387365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9cf20-0036-4dde-b00b-d38fa398d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.388171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b7a45c1f-ce07-438c-a494-6956d091069d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.389438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b7a45c1f-ce07-438c-a494-6956d091069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.397530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 782/1560] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.401051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.402052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45c1f-ce07-438c-a494-6956d091069d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.407334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e2b9cf20-0036-4dde-b00b-d38fa398d43b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.408843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e2b9cf20-0036-4dde-b00b-d38fa398d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.411383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45c1f-ce07-438c-a494-6956d091069d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.415942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.416591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.416864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.417130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.417494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 779/1561] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.417812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.418133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.418297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9cf20-0036-4dde-b00b-d38fa398d43b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.419784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.422690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.428035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9cf20-0036-4dde-b00b-d38fa398d43b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.439998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 783/1562] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.440213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.440337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.440433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.440433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.440433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.440433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.440433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:20:31.440433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:20:31.440433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:20:31.441005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.446356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129b27c5-9ea9-4c8b-9e0e-9a7afcd2fdbe admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.451274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.451891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.452172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.452445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.453118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.454173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:20:31.454173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: warnings.warn(msg) Aug 06 01:20:31.454173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: Aug 06 01:20:31.455378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.469592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 780/1563] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.471012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.477488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 784/1564] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.481313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.490647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613ed6-a1cf-48bb-9511-73b98748e2b3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.536572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aba346d-d71c-460c-a761-a37f61c8fb09 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.541815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf839b-1ad8-495e-ae0c-9566c1164614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.542533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf839b-1ad8-495e-ae0c-9566c1164614 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.542840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf839b-1ad8-495e-ae0c-9566c1164614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.543116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf839b-1ad8-495e-ae0c-9566c1164614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.543797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf839b-1ad8-495e-ae0c-9566c1164614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.545469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf839b-1ad8-495e-ae0c-9566c1164614 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.551537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.552167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.552568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.552738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.553438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.553747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.555428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.555947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 781/1565] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:31.557285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e80d-2773-4ed5-a9a2-c24a872f5406 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.557704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e80d-2773-4ed5-a9a2-c24a872f5406 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.558018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e80d-2773-4ed5-a9a2-c24a872f5406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.567767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 785/1566] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.568887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.580509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5b737-69c4-4528-84c4-65a1f590cde8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.580718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-29f5e80d-2773-4ed5-a9a2-c24a872f5406 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:31.581772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-29f5e80d-2773-4ed5-a9a2-c24a872f5406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:31.585622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.586273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.586553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.586828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.587558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.587863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.589528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.589748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 782/1567] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:31.594113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5e80d-2773-4ed5-a9a2-c24a872f5406 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.602536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 786/1568] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.603364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.611368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5e80d-2773-4ed5-a9a2-c24a872f5406 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.613300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bf324-1bd0-4e37-914a-7e82e21c858e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.616421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.617052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.617339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.617606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.618448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.618664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.618837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.619253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.619673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.619954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.620397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.620616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.622939 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.633093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 783/1569] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.634608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.651264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de06500-b733-4b63-ab5f-cdbfe4198a3a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.656788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 787/1570] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.656788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.707412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.708051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.708327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.708593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.709290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.711481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.715751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33784d2c-47d9-427c-8903-d98012408551 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.720484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.721112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.721391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.721667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.722398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.724139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.736945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 784/1571] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.737146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 788/1572] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:31.737252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.737366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.745333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983ac2af-7d5c-4b35-8435-c4ec3963f70d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.749835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd0120-555b-4d2d-9800-9641ad2cf0e0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.750321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.750929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.751206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.751479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.752145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.754069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.754583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.755251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.755533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.755809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] PATH_INFO: `/v3/projects/459c1f2b2d0442148f46cd110f168d78/users/e813148105af4a0480c3c9c4bb3b999f/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.771623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=459c1f2b2d0442148f46cd110f168d78, user_id=e813148105af4a0480c3c9c4bb3b999f, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.772846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:20:31.772846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:20:31.772846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:20:31.775004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.783360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 789/1573] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.784193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.788986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 785/1574] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:31 2022] PUT /identity/v3/projects/459c1f2b2d0442148f46cd110f168d78/users/e813148105af4a0480c3c9c4bb3b999f/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:31.789830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.796940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.819896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:31.849019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1516db-6e32-4491-977b-3e2733c44cf8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.859961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702c3f6-0917-427f-906c-a33e62300075 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.864855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.865476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.865756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.866056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.866722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.868650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.901462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 786/1575] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/projects => generated 355 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:31.901462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.906717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.907355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.907633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.907905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.908605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:31.908910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.910562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.922157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 790/1576] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:31.923327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:31.933099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cedcb-bf8c-4f53-8efe-2df73bedab9e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.966234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420f610-f74b-4a5a-a13a-25f2e1ecbe0e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:31.971026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.971660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.971938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.972211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.972875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.974858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:31.989618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:31.990278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:31.990552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:31.990822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:31.991454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:31.993382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.005610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 787/1577] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:32.006500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.018930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 791/1578] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:31 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:32.019769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.032154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37768ccb-59cf-403c-ad28-81df2423cc18 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.071157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d79c7-4614-4da2-9a1f-330f0a04b896 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.072161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.076652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.077282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.077560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.077870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.078635 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.080250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.089247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b026918-b162-4a38-9ff6-1e5e562d7239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.089911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b026918-b162-4a38-9ff6-1e5e562d7239 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.090225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b026918-b162-4a38-9ff6-1e5e562d7239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.090488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 788/1579] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.090601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b026918-b162-4a38-9ff6-1e5e562d7239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.091244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b026918-b162-4a38-9ff6-1e5e562d7239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.091351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.092889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b026918-b162-4a38-9ff6-1e5e562d7239 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.100927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39066-dab9-409b-8b91-5e1a09833be0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.106239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 792/1580] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.106239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05f87-4071-4546-8a3b-a072f98ef831 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.106239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05f87-4071-4546-8a3b-a072f98ef831 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.106239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05f87-4071-4546-8a3b-a072f98ef831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.106746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.106746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.106951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.107163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.107876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.109862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.134917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 789/1581] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:32.134917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.136260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a1d05f87-4071-4546-8a3b-a072f98ef831 None None] MFA Rules not processed for user `e813148105af4a0480c3c9c4bb3b999f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:32.137537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a1d05f87-4071-4546-8a3b-a072f98ef831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:32.145384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb20d2f-15c6-4f48-8f1e-b8506c23d125 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.150760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.151367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.151649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.151920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.152611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.154612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.163365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.180216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 790/1582] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/users => generated 278 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:32.181151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.191173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9f407-ecb4-440c-b0a7-0abb6264539b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.195742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.196481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.196650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.196888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.197603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.199615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.207365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 793/1583] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:32.212020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05f87-4071-4546-8a3b-a072f98ef831 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.224327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05f87-4071-4546-8a3b-a072f98ef831 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.228843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 791/1584] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:32.229751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.230275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.231047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.231415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.231785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.233082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.235156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.257952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 794/1585] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:32.258892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.269364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f0608-d535-453c-8e01-e55374d1a905 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.295112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdabdbb-c32b-47f8-9271-b9490cf15420 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.301632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.302374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.302660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.302929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.303639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.305293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.316270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 792/1586] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.317072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.326951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83588bdd-fef4-49d2-ad29-054802da432c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.330642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.331281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.331492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.331601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.331932 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.332152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.332431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.332645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.332746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] PATH_INFO: `/v3/projects/52cc55c0d0e54259b75fc1bbecf809f4/users/e1a09994c5b647ab9d40a158fee62f1d/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.334303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.345153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 795/1587] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.346032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.350454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cc55c0d0e54259b75fc1bbecf809f4, user_id=e1a09994c5b647ab9d40a158fee62f1d, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.353193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.355646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee0e2-efaf-46e4-8426-1b53f061fa8d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.360663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.361317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.361598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.361873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.362619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.364182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.367899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 793/1588] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:32 2022] PUT /identity/v3/projects/52cc55c0d0e54259b75fc1bbecf809f4/users/e1a09994c5b647ab9d40a158fee62f1d/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:32.368769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.374748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 796/1589] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.376127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.413289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.432251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7d47f-6fb4-45f3-9212-0a78eff2729e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.437504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7529dc4-5b53-4026-9f94-2120017730c4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.442798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.443427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.443705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.444017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.444709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.446496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.456541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 794/1590] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.457309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.467227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d90686-4107-4a93-b0fe-ad964dbc4ddf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.471890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.472483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.472761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.473032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.473669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.475653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.484395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.485030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.485311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.485584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.502848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 795/1591] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:32.503088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.516445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a94459-f473-4831-9759-eceb87a67029 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.521454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.522122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.522421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.522682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.523503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.525131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.535781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 796/1592] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.536599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.546217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe701f6-d882-4e0c-9fc6-422badf6463d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.550716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ed4a5-6401-45b7-b857-063beebbd13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.551056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.551293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed4a5-6401-45b7-b857-063beebbd13c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.551569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed4a5-6401-45b7-b857-063beebbd13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.551839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ed4a5-6401-45b7-b857-063beebbd13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.552508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ed4a5-6401-45b7-b857-063beebbd13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.552609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.554129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ed4a5-6401-45b7-b857-063beebbd13c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.556412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.562416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 797/1593] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:32.563545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.569451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 797/1594] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.570829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ca21b-f628-4c1c-8085-6d8d5a9385a3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.571117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ca21b-f628-4c1c-8085-6d8d5a9385a3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.571392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ca21b-f628-4c1c-8085-6d8d5a9385a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.574431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2855d6-2aeb-4808-871b-5c9651f0ba14 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.579074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.579754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.580086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.580413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] PATH_INFO: `/v3/projects/78e711b72a0143a1a6be082c862841d1/users/46c3c63c45ed4882bd7b4b70bea2f613/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.593713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-730ca21b-f628-4c1c-8085-6d8d5a9385a3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:32.594952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-730ca21b-f628-4c1c-8085-6d8d5a9385a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:32.595285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e711b72a0143a1a6be082c862841d1, user_id=46c3c63c45ed4882bd7b4b70bea2f613, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.597975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.603178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 798/1595] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:32.604274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ca21b-f628-4c1c-8085-6d8d5a9385a3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.614607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ca21b-f628-4c1c-8085-6d8d5a9385a3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.614800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 798/1596] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:32 2022] PUT /identity/v3/projects/78e711b72a0143a1a6be082c862841d1/users/46c3c63c45ed4882bd7b4b70bea2f613/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:32.615728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.675735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.677250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.677754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.678264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.679276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.681091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.683396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236b9b0-b3a1-4302-9b60-a4b82950fb14 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.688103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.688744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.689014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.689281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.690003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.691619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.696669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 799/1597] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.696669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.707110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 799/1598] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.707110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.710837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e1fc9-42dd-4ebd-94b2-b15ac583440e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.716367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f254c2d-bff1-427e-b48b-a41068683620 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.716886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.717244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.717587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.718243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.720948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.720948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.723037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.723667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.723939 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.724293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.724993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.726625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.740550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 800/1599] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.740550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.747951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52be1e-3e38-4617-acc6-ac4c93dbe0f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.750948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 800/1600] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:32.752343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.753058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb5e42-5619-45f7-a57b-517bcab5b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.753734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5e42-5619-45f7-a57b-517bcab5b98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.754185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5e42-5619-45f7-a57b-517bcab5b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.754469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb5e42-5619-45f7-a57b-517bcab5b98f admin admin] PATH_INFO: `/v3/projects/6fe21a0eece0476aa30f6738b3d394be/users/eef6662134a14362bd6dd6d1a13b2e63/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.767981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:32.771199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5e42-5619-45f7-a57b-517bcab5b98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe21a0eece0476aa30f6738b3d394be, user_id=eef6662134a14362bd6dd6d1a13b2e63, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.775479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb5e42-5619-45f7-a57b-517bcab5b98f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.796342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 801/1601] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:32 2022] PUT /identity/v3/projects/6fe21a0eece0476aa30f6738b3d394be/users/eef6662134a14362bd6dd6d1a13b2e63/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:32.796342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832aa2-62f0-42be-a829-2c2a8d92a3dc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.796342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832aa2-62f0-42be-a829-2c2a8d92a3dc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.796342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c832aa2-62f0-42be-a829-2c2a8d92a3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.814731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4c832aa2-62f0-42be-a829-2c2a8d92a3dc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:32.815944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4c832aa2-62f0-42be-a829-2c2a8d92a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:32.824859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdadfc-f5e8-4cc3-bb15-ccbe8de7d323 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.889196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.890225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.890542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.891491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.895243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 802/1602] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:32.895243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832aa2-62f0-42be-a829-2c2a8d92a3dc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.907559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.909257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.911756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c832aa2-62f0-42be-a829-2c2a8d92a3dc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.916533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.917207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.917486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.917757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] PATH_INFO: `/v3/projects/1b1776d037f94d37a8ed6a95c3303259/users/bef2265fc5044f878ba35c90c24a634d/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.920014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 801/1603] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:32.920844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.930293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02a399-b111-4f66-ad04-d7b259fb983e service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:32.935831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:32.936569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:32.936909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:32.937246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] PATH_INFO: `/v3/projects/a56ea9da94224144b979d29e1532b955/users/1788980004f24fb99dda54ac60c13808/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:32.952462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1776d037f94d37a8ed6a95c3303259, user_id=bef2265fc5044f878ba35c90c24a634d, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.954440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56ea9da94224144b979d29e1532b955, user_id=1788980004f24fb99dda54ac60c13808, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:32.956986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.957625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:32.975530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 802/1604] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:32 2022] PUT /identity/v3/projects/a56ea9da94224144b979d29e1532b955/users/1788980004f24fb99dda54ac60c13808/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:32.976648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:32.981765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 803/1605] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:32 2022] PUT /identity/v3/projects/1b1776d037f94d37a8ed6a95c3303259/users/bef2265fc5044f878ba35c90c24a634d/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:32.982719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.031343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.070108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f486c1f-90a0-4dce-a15b-ac95fe0ab4a1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.078235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479490a-aac6-4004-8c5a-1d08bdbf7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.078915 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e26c6b-5028-4d7f-a120-afe2fa766400 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.080889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479490a-aac6-4004-8c5a-1d08bdbf7028 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.081625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479490a-aac6-4004-8c5a-1d08bdbf7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.083582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479490a-aac6-4004-8c5a-1d08bdbf7028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.084365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29a4b5-643f-4e5a-8999-2a99ea4370dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.085061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29a4b5-643f-4e5a-8999-2a99ea4370dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.085341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29a4b5-643f-4e5a-8999-2a99ea4370dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.085458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479490a-aac6-4004-8c5a-1d08bdbf7028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.086021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29a4b5-643f-4e5a-8999-2a99ea4370dd admin admin] PATH_INFO: `/v3/projects/c85000b602ec439aa3394604349bf156/users/db7f489ef07941be9a0611a0030e4f6a/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.087375 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479490a-aac6-4004-8c5a-1d08bdbf7028 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.104665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 803/1606] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:33.106529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff017-c1f1-4afd-875b-3c47053ed848 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.107037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff017-c1f1-4afd-875b-3c47053ed848 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.107936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff017-c1f1-4afd-875b-3c47053ed848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.131009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29a4b5-643f-4e5a-8999-2a99ea4370dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c85000b602ec439aa3394604349bf156, user_id=db7f489ef07941be9a0611a0030e4f6a, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.137426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e20ff017-c1f1-4afd-875b-3c47053ed848 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:33.138084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29a4b5-643f-4e5a-8999-2a99ea4370dd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.139548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e20ff017-c1f1-4afd-875b-3c47053ed848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:33.166647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 804/1607] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:33.166647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff017-c1f1-4afd-875b-3c47053ed848 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.183361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 804/1608] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:32 2022] PUT /identity/v3/projects/c85000b602ec439aa3394604349bf156/users/db7f489ef07941be9a0611a0030e4f6a/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:33.184649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dd82-b94e-467f-9001-bb950cad8381 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.187787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dd82-b94e-467f-9001-bb950cad8381 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.188039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20dd82-b94e-467f-9001-bb950cad8381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.227819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5b20dd82-b94e-467f-9001-bb950cad8381 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:33.231067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b20dd82-b94e-467f-9001-bb950cad8381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:33.260393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.293550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff017-c1f1-4afd-875b-3c47053ed848 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.345975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 805/1609] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:33.347534 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1f6-3e73-4692-bf8c-b2dd42de5874 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.347820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1f6-3e73-4692-bf8c-b2dd42de5874 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.348097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbe1f6-3e73-4692-bf8c-b2dd42de5874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.365710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.366745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.367070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.367763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.380269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.382231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.387464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-36bbe1f6-3e73-4692-bf8c-b2dd42de5874 None None] MFA Rules not processed for user `1788980004f24fb99dda54ac60c13808`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:33.388714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36bbe1f6-3e73-4692-bf8c-b2dd42de5874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:33.410507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 805/1610] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:33.412500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.429277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425005-b034-46e9-baea-827e50fb3410 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.435675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72cac-fd7a-4caf-8f0b-a72ec337ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.436865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72cac-fd7a-4caf-8f0b-a72ec337ea11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.438176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72cac-fd7a-4caf-8f0b-a72ec337ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.438659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72cac-fd7a-4caf-8f0b-a72ec337ea11 admin admin] PATH_INFO: `/v3/projects/b72d3b14865842b5af5196261ba4f10c/users/1247b98092164ba4b3253391c3914158/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.460949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba72cac-fd7a-4caf-8f0b-a72ec337ea11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72d3b14865842b5af5196261ba4f10c, user_id=1247b98092164ba4b3253391c3914158, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.466012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba72cac-fd7a-4caf-8f0b-a72ec337ea11 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.474616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 806/1611] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:33.475503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe1f6-3e73-4692-bf8c-b2dd42de5874 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.488485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbe1f6-3e73-4692-bf8c-b2dd42de5874 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.503877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 806/1612] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:33 2022] PUT /identity/v3/projects/b72d3b14865842b5af5196261ba4f10c/users/1247b98092164ba4b3253391c3914158/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:33.506093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bab55-7a8c-4d24-aad9-e6329581a390 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.506345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bab55-7a8c-4d24-aad9-e6329581a390 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.506663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bab55-7a8c-4d24-aad9-e6329581a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.542097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.546109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-550bab55-7a8c-4d24-aad9-e6329581a390 None None] MFA Rules not processed for user `db7f489ef07941be9a0611a0030e4f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:33.547412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-550bab55-7a8c-4d24-aad9-e6329581a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:33.553504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.554385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.554810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.555191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.635797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.638450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.642582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 807/1613] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:33.643812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bab55-7a8c-4d24-aad9-e6329581a390 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.660475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bab55-7a8c-4d24-aad9-e6329581a390 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.666526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 807/1614] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:33.667812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.671430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76040ed0-5e47-4409-bfe0-67d5e474263c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.672198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040ed0-5e47-4409-bfe0-67d5e474263c service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.672609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040ed0-5e47-4409-bfe0-67d5e474263c service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.672941 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76040ed0-5e47-4409-bfe0-67d5e474263c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.681197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61e8b9-0d2f-4e1f-8571-63189fcd1663 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.686441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76040ed0-5e47-4409-bfe0-67d5e474263c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.687561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9c1fa-45b8-4539-b2fb-5a9effe74547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.688160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76040ed0-5e47-4409-bfe0-67d5e474263c service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.688579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9c1fa-45b8-4539-b2fb-5a9effe74547 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.689143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9c1fa-45b8-4539-b2fb-5a9effe74547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.689518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9c1fa-45b8-4539-b2fb-5a9effe74547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.690647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9c1fa-45b8-4539-b2fb-5a9effe74547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.693445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9c1fa-45b8-4539-b2fb-5a9effe74547 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.700297 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 808/1615] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:33.703580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423161a-db46-4de2-91f3-674272b4d2eb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.703950 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423161a-db46-4de2-91f3-674272b4d2eb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.704256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423161a-db46-4de2-91f3-674272b4d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.742432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 808/1616] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/projects => generated 357 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:33.743796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6423161a-db46-4de2-91f3-674272b4d2eb None None] MFA Rules not processed for user `1247b98092164ba4b3253391c3914158`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:33.744851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22401-4294-4ae3-98cd-2de0384cb3c6 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.745237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22401-4294-4ae3-98cd-2de0384cb3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.745350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6423161a-db46-4de2-91f3-674272b4d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:33.745519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d22401-4294-4ae3-98cd-2de0384cb3c6 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.752877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 809/1617] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 01:20:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:33.754487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d22401-4294-4ae3-98cd-2de0384cb3c6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.785370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:33.829441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 809/1618] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:33.831437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd105-b03a-4f07-8668-1beb7ce146e4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.831875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd105-b03a-4f07-8668-1beb7ce146e4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.832563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddd105-b03a-4f07-8668-1beb7ce146e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.848159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d22401-4294-4ae3-98cd-2de0384cb3c6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.853620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.854466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.855105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.855446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.856298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.859108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.894929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 810/1619] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/users => generated 285 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:33.900813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:33.903746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-60ddd105-b03a-4f07-8668-1beb7ce146e4 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:33.905440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-60ddd105-b03a-4f07-8668-1beb7ce146e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:33.914590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205dccb-926c-4629-a225-0212390b650f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:33.922477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:33.923187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:33.923599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:33.923783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:33.925223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:33.928140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:33.969562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 811/1620] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:33.974363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.021250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 810/1621] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 01:20:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:34.022977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddd105-b03a-4f07-8668-1beb7ce146e4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.041059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddd105-b03a-4f07-8668-1beb7ce146e4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.046588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.084812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23fb1-8b10-4e9d-88a4-d44bb48b251e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.091221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.091976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.092263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.092539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.094794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.096935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.115608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 812/1622] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:34.117687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.182332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.184003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.184003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.184244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.184832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.200381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.250680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 811/1623] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:34 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:34.252084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.273120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28de18-9ac4-4784-b771-894c164d6fe0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.282429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.283298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.283595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.283931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.300562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6cf4d-be70-45af-b06f-1e94a85daa34 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.316428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.317454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.318011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.318501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] PATH_INFO: `/v3/projects/a0ee1986c97f448ca65f9e448becd6a2/users/4a917040d7fc4a9ab286880fb849c022/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.355799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ee1986c97f448ca65f9e448becd6a2, user_id=4a917040d7fc4a9ab286880fb849c022, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.361074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.384716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.390097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.414852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 812/1624] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:34 2022] PUT /identity/v3/projects/a0ee1986c97f448ca65f9e448becd6a2/users/4a917040d7fc4a9ab286880fb849c022/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:34.418077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.435452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 813/1625] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:34.438026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.456848 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.458745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b74ae-2443-41de-b031-03707103dde6 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.557202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7115fbf-f3f8-488e-a579-4e0b4e27b335 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.562000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.563852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.565400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.566268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.567826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.567944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.568593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.568907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.569186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.573242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.573778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.574922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.608369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 814/1626] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:34.611458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 813/1627] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:34.615630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.624651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.647042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c613e7-3efa-42cf-b129-51d836c9444d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.656185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d28401-5a0c-4b2c-8f05-fac74a400847 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.664469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.665176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.665461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.670727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] PATH_INFO: `/v3/projects/82920501e45b44cc90f7f55dead68814/users/74df30790dc148dea2af4de7bd849a99/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.678026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebe7bf-0f93-4698-be1b-0fadb1d0ab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.678756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebe7bf-0f93-4698-be1b-0fadb1d0ab22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.679364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebe7bf-0f93-4698-be1b-0fadb1d0ab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.679613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:34.679735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebe7bf-0f93-4698-be1b-0fadb1d0ab22 admin admin] PATH_INFO: `/v3/projects/a0ee1986c97f448ca65f9e448becd6a2/users/4a917040d7fc4a9ab286880fb849c022/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.690377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebe7bf-0f93-4698-be1b-0fadb1d0ab22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ee1986c97f448ca65f9e448becd6a2, user_id=4a917040d7fc4a9ab286880fb849c022, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.698215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebe7bf-0f93-4698-be1b-0fadb1d0ab22 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.722683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=82920501e45b44cc90f7f55dead68814, user_id=74df30790dc148dea2af4de7bd849a99, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.726967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.732154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 814/1628] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:34 2022] PUT /identity/v3/projects/a0ee1986c97f448ca65f9e448becd6a2/users/4a917040d7fc4a9ab286880fb849c022/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:34.743308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6377c1e-0ead-41a7-9d03-560a410c98b7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.744275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6377c1e-0ead-41a7-9d03-560a410c98b7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.744275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6377c1e-0ead-41a7-9d03-560a410c98b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.762038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 815/1629] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:34 2022] PUT /identity/v3/projects/82920501e45b44cc90f7f55dead68814/users/74df30790dc148dea2af4de7bd849a99/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:34.767189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.823176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c6377c1e-0ead-41a7-9d03-560a410c98b7 None None] MFA Rules not processed for user `4a917040d7fc4a9ab286880fb849c022`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:34.833825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c6377c1e-0ead-41a7-9d03-560a410c98b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:34.901532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34315f-ab41-4439-bd1a-720ca9a0a3af admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.913791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030056f2-e2a8-4b9f-a9bf-a774c5de3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.914534 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030056f2-e2a8-4b9f-a9bf-a774c5de3331 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.914992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030056f2-e2a8-4b9f-a9bf-a774c5de3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.915321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030056f2-e2a8-4b9f-a9bf-a774c5de3331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.916036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030056f2-e2a8-4b9f-a9bf-a774c5de3331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.920030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030056f2-e2a8-4b9f-a9bf-a774c5de3331 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.939843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 816/1630] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:20:34.941492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852dcfc-e8ba-4848-a3cf-dfa307a03f21 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.942256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852dcfc-e8ba-4848-a3cf-dfa307a03f21 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.942256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852dcfc-e8ba-4848-a3cf-dfa307a03f21 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.951565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 817/1631] 10.222.0.17 () {54 vars in 962 bytes} [Sat Aug 6 01:20:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:34.952254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e355b-0c17-4c1e-9778-6abc746bcfbe None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.952719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e355b-0c17-4c1e-9778-6abc746bcfbe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.953000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e355b-0c17-4c1e-9778-6abc746bcfbe None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.954791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 818/1632] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 01:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:34.955504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e355b-0c17-4c1e-9778-6abc746bcfbe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:34.970656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e355b-0c17-4c1e-9778-6abc746bcfbe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:34.976316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ffd7a-0da7-40ee-b956-ae3891f0c004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:34.977158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffd7a-0da7-40ee-b956-ae3891f0c004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.977436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffd7a-0da7-40ee-b956-ae3891f0c004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.977714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffd7a-0da7-40ee-b956-ae3891f0c004 admin admin] PATH_INFO: `/v3/projects/82920501e45b44cc90f7f55dead68814/users/74df30790dc148dea2af4de7bd849a99/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:34.980018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ffd7a-0da7-40ee-b956-ae3891f0c004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82920501e45b44cc90f7f55dead68814, user_id=74df30790dc148dea2af4de7bd849a99, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:34.982804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ffd7a-0da7-40ee-b956-ae3891f0c004 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:34.995488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 819/1633] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:34 2022] PUT /identity/v3/projects/82920501e45b44cc90f7f55dead68814/users/74df30790dc148dea2af4de7bd849a99/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:34.997015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141359-dbc6-4121-944a-eab0df560fba None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:34.997845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141359-dbc6-4121-944a-eab0df560fba None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:34.998238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141359-dbc6-4121-944a-eab0df560fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.026900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3b141359-dbc6-4121-944a-eab0df560fba None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:35.028456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b141359-dbc6-4121-944a-eab0df560fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:35.038487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 815/1634] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:35.041998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a6ae-e3d2-42df-a02c-d825e255a243 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.042423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a6ae-e3d2-42df-a02c-d825e255a243 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.042703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a6ae-e3d2-42df-a02c-d825e255a243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.081471 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f204a6ae-e3d2-42df-a02c-d825e255a243 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:35.083067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f204a6ae-e3d2-42df-a02c-d825e255a243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:35.212285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 816/1635] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:35.213956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b7cc0-ae1c-4d99-a284-96d95d1bfa88 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.214262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b7cc0-ae1c-4d99-a284-96d95d1bfa88 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.214640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b7cc0-ae1c-4d99-a284-96d95d1bfa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.236126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 820/1636] 10.222.0.17 () {58 vars in 1059 bytes} [Sat Aug 6 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:35.237145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141359-dbc6-4121-944a-eab0df560fba None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.252720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-658b7cc0-ae1c-4d99-a284-96d95d1bfa88 None None] MFA Rules not processed for user `74df30790dc148dea2af4de7bd849a99`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:35.254686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-658b7cc0-ae1c-4d99-a284-96d95d1bfa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:35.260263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.357476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141359-dbc6-4121-944a-eab0df560fba None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.362446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.363293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.364209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.364494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.378142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:35.379077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 817/1637] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:35.380196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b7cc0-ae1c-4d99-a284-96d95d1bfa88 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.407123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b7cc0-ae1c-4d99-a284-96d95d1bfa88 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.413729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd62b50-c56b-41a4-9922-4e077bfec956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.414456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62b50-c56b-41a4-9922-4e077bfec956 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.415171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62b50-c56b-41a4-9922-4e077bfec956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.416181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd62b50-c56b-41a4-9922-4e077bfec956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.441146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd62b50-c56b-41a4-9922-4e077bfec956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.444135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd62b50-c56b-41a4-9922-4e077bfec956 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.473434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 818/1638] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:35.476306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc09ca-8174-4a7d-8d0c-d26dfc21d080 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.476753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc09ca-8174-4a7d-8d0c-d26dfc21d080 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.477380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc09ca-8174-4a7d-8d0c-d26dfc21d080 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.479478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 819/1639] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 01:20:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:35.486806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ef3d7-99da-452b-883f-e2efa9945534 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.487410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ef3d7-99da-452b-883f-e2efa9945534 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.488254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8ef3d7-99da-452b-883f-e2efa9945534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.512523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.516250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.565401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7e8ef3d7-99da-452b-883f-e2efa9945534 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:35.568621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 821/1640] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:35.571184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.574113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7e8ef3d7-99da-452b-883f-e2efa9945534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:35.599021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860aec8-71cd-4e0a-bf8e-54667f6e5e25 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.609885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 820/1641] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:35.610816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.612113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.617581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.618550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.646856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ef3d7-99da-452b-883f-e2efa9945534 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.649005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.652928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.666105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8ef3d7-99da-452b-883f-e2efa9945534 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:35.677379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 822/1642] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:35.681478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:35.682371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:35.682651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:35.682925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:35.698531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:35.700126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:35.714952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 821/1643] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:35.983734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:35.993869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.003796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc3a8-0d8a-4faf-bedf-79c33239b017 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.034937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e1ed7-278b-43e9-9d5b-24296f8f9db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.035687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1ed7-278b-43e9-9d5b-24296f8f9db4 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.035900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1ed7-278b-43e9-9d5b-24296f8f9db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.036178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e1ed7-278b-43e9-9d5b-24296f8f9db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.138607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62379823-85d1-474e-a3c9-d8aec1a1cfcd service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.151378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.152057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.152339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.152680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] PATH_INFO: `/v3/users/db7f489ef07941be9a0611a0030e4f6a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.154008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db7f489ef07941be9a0611a0030e4f6a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.155055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: WARNING py.warnings [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:20:36.155055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: warnings.warn(msg) Aug 06 01:20:36.155055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: Aug 06 01:20:36.156276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.161532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1ed7-278b-43e9-9d5b-24296f8f9db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.162157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e1ed7-278b-43e9-9d5b-24296f8f9db4 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.175610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 822/1644] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:36.301371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db7f489ef07941be9a0611a0030e4f6a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:36.330668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db7f489ef07941be9a0611a0030e4f6a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:36.332387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db7f489ef07941be9a0611a0030e4f6a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:36.387411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db7f489ef07941be9a0611a0030e4f6a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:36.410997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db7f489ef07941be9a0611a0030e4f6a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:36.424047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 823/1645] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:20:35 2022] DELETE /identity/v3/users/db7f489ef07941be9a0611a0030e4f6a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:36.428677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.429156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.429797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.463644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.467154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:36.485001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:36.491939 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:36.504698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.631817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 823/1646] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:36.649793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9033d-ad6a-45d2-ba8b-7b7eccb19941 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.657746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.658517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.658783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.659128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.660920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:36.704401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:36.707253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:36.724352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:36.865391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.868586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.875090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29493c-5c86-428f-84d9-0e8ec50dad58 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:36.885528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4517a82-e41f-479f-9eb6-05d6a560038c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:36.886181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517a82-e41f-479f-9eb6-05d6a560038c service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:36.886463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517a82-e41f-479f-9eb6-05d6a560038c service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:36.886736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517a82-e41f-479f-9eb6-05d6a560038c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:36.900107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 824/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:36.929727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4517a82-e41f-479f-9eb6-05d6a560038c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:36.931254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4517a82-e41f-479f-9eb6-05d6a560038c service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:36.980557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 824/1648] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:37.978592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:37.982539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:38.015846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765b5cb-5fd1-4b22-945f-730aefbc1dc3 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.034164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.034975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.036056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.036534 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] PATH_INFO: `/v3/projects/c85000b602ec439aa3394604349bf156` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.038235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c85000b602ec439aa3394604349bf156)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.040660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.164766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c85000b602ec439aa3394604349bf156', 'request_id': 'req-200fe7d2-11db-4779-98ca-9222218460ba'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:38.188978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c85000b602ec439aa3394604349bf156', 'request_id': 'req-200fe7d2-11db-4779-98ca-9222218460ba'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:38.198805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c85000b602ec439aa3394604349bf156', 'request_id': 'req-200fe7d2-11db-4779-98ca-9222218460ba'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:38.240095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] The token cache is being invalidate because project c85000b602ec439aa3394604349bf156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:20:38.240403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:38.241286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-200fe7d2-11db-4779-98ca-9222218460ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:38.247748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 825/1649] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:20:37 2022] DELETE /identity/v3/projects/c85000b602ec439aa3394604349bf156 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:38.253356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5dd5-7b1e-4fc9-af91-d6293382f636 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.254531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5dd5-7b1e-4fc9-af91-d6293382f636 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.255089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a5dd5-7b1e-4fc9-af91-d6293382f636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.286843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-308a5dd5-7b1e-4fc9-af91-d6293382f636 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:38.288615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-308a5dd5-7b1e-4fc9-af91-d6293382f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:38.379506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 825/1650] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:38.390894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636e14-312b-4b2a-8963-d6020210043b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.391749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636e14-312b-4b2a-8963-d6020210043b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.394288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01636e14-312b-4b2a-8963-d6020210043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.450973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-01636e14-312b-4b2a-8963-d6020210043b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:38.459703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-01636e14-312b-4b2a-8963-d6020210043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:38.478951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 826/1651] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:38.482925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5dd5-7b1e-4fc9-af91-d6293382f636 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.496593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a5dd5-7b1e-4fc9-af91-d6293382f636 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.519732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.520649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.523067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.523532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.524453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:38.526113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.535957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.575738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 826/1652] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:20:38.576390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636e14-312b-4b2a-8963-d6020210043b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.591492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01636e14-312b-4b2a-8963-d6020210043b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.603723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.606623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.607233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.607704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.608519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.615083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:38.679861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 827/1653] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:38 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:38.683239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:38.713975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470a2c0-97b0-4d01-9218-5783a0445a61 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:38.917468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:38.919417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:38.919703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:38.921123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:38.921865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:38.931127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.004865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 827/1654] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:38 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:39.009234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.028927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84828b-890f-436b-ba59-b55a7cb29f9b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.044437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.048420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.049084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.049612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.052142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:39.056968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.092534 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 828/1655] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:39.093877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.109254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06b3df-493e-4138-b385-b2c000556bcf admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.123755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17ab1e-5590-4700-baf7-1142afb20b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.124639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ab1e-5590-4700-baf7-1142afb20b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.126486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ab1e-5590-4700-baf7-1142afb20b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.128649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17ab1e-5590-4700-baf7-1142afb20b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.129455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17ab1e-5590-4700-baf7-1142afb20b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:39.138137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17ab1e-5590-4700-baf7-1142afb20b52 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.185029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 828/1656] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:20:39.189433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.208637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a50ee-8453-4ebd-956f-13180e9b15cc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.227372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.229543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.230024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.231631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] PATH_INFO: `/v3/projects/b03cd46157a04575a1350641c7131c57/users/9b04816cb03d48c8a723b7dcca8679e4/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.253636 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:39.276240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03cd46157a04575a1350641c7131c57, user_id=9b04816cb03d48c8a723b7dcca8679e4, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:39.281876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:39.324820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 829/1657] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:39 2022] PUT /identity/v3/projects/b03cd46157a04575a1350641c7131c57/users/9b04816cb03d48c8a723b7dcca8679e4/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:39.325082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60940-18bf-4b15-992f-12a8c56c48c5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.325569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60940-18bf-4b15-992f-12a8c56c48c5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.325669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60940-18bf-4b15-992f-12a8c56c48c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.444714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8fc60940-18bf-4b15-992f-12a8c56c48c5 None None] MFA Rules not processed for user `9b04816cb03d48c8a723b7dcca8679e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:39.449918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8fc60940-18bf-4b15-992f-12a8c56c48c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:39.460505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:39.720555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 829/1658] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:39.721903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:39.948816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd40ba-fd93-4806-8195-dff9d312bba1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:39.986826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:39.991172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:39.991505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:39.991778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:39.992486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.002560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.119597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc60940-18bf-4b15-992f-12a8c56c48c5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.125017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 830/1659] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:39 2022] POST /identity/v3/projects => generated 379 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:40.187181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc60940-18bf-4b15-992f-12a8c56c48c5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.383643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.385162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.385589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.386130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.388550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.390957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.446541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 830/1660] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:40 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:40.448283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.470043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a8662-069e-4de5-8bdb-b4ce71148f37 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.494714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.495990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.499121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.499628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.501227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.505857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.567152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 831/1661] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:40.572776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.600522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ddd4-04ea-4134-9d2f-fff05570611b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.633560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.636313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.636800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.638332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] PATH_INFO: `/v3/projects/efbdfc6d54b4411da5fba060f66c8358/users/df88fae26d124d74b774956d721dfed5/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.690801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdfc6d54b4411da5fba060f66c8358, user_id=df88fae26d124d74b774956d721dfed5, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.693983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.747807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 831/1662] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:40 2022] PUT /identity/v3/projects/efbdfc6d54b4411da5fba060f66c8358/users/df88fae26d124d74b774956d721dfed5/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:40.751814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.779898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594fb03-e5a6-432b-a8e0-71e2a71c3922 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.946021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250bcfe-482d-4f35-b1a6-fc5038216ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:40.946853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250bcfe-482d-4f35-b1a6-fc5038216ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:40.947184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250bcfe-482d-4f35-b1a6-fc5038216ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:40.947457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250bcfe-482d-4f35-b1a6-fc5038216ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:40.948212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250bcfe-482d-4f35-b1a6-fc5038216ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:40.949872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250bcfe-482d-4f35-b1a6-fc5038216ce1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:40.975784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:40.981420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 832/1663] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:40.986806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834388d5-15a5-42ea-a8f6-d44f935b0aa0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:40.999365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.000073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.000346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.000629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] PATH_INFO: `/v3/projects/efbdfc6d54b4411da5fba060f66c8358/users/df88fae26d124d74b774956d721dfed5/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.004324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdfc6d54b4411da5fba060f66c8358, user_id=df88fae26d124d74b774956d721dfed5, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.007059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.038618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 832/1664] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:40 2022] PUT /identity/v3/projects/efbdfc6d54b4411da5fba060f66c8358/users/df88fae26d124d74b774956d721dfed5/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:41.051238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c469-7299-4c87-b90c-dae77a8c0767 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.051442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c469-7299-4c87-b90c-dae77a8c0767 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.051747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726c469-7299-4c87-b90c-dae77a8c0767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.142144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f726c469-7299-4c87-b90c-dae77a8c0767 None None] MFA Rules not processed for user `df88fae26d124d74b774956d721dfed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:41.144115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f726c469-7299-4c87-b90c-dae77a8c0767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:41.254298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.337742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 833/1665] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:41.497922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:41.509263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:41.690013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36a6be-46ed-4f47-bdf2-ece8c59a7776 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:41.701643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:41.702494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:41.702771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:41.703475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:41.726583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:41.728991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:41.752091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:41.764310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 833/1666] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:42.047298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726c469-7299-4c87-b90c-dae77a8c0767 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:42.061518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726c469-7299-4c87-b90c-dae77a8c0767 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:42.077985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a57f1-7a6f-401b-bb9e-a99c3a892756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:42.078934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a57f1-7a6f-401b-bb9e-a99c3a892756 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:42.079218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a57f1-7a6f-401b-bb9e-a99c3a892756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:42.079546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a57f1-7a6f-401b-bb9e-a99c3a892756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:42.240396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a57f1-7a6f-401b-bb9e-a99c3a892756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:42.248903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a57f1-7a6f-401b-bb9e-a99c3a892756 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:42.273289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 834/1667] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:46.579182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:46.580842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:46.759410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73bcc2-c283-4712-8d4a-3376673bf853 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:46.770690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:46.771412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:46.771697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:46.771972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] PATH_INFO: `/v3/users/e813148105af4a0480c3c9c4bb3b999f` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:46.779054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e813148105af4a0480c3c9c4bb3b999f)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:46.783266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:46.881231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e813148105af4a0480c3c9c4bb3b999f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:46.898169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e813148105af4a0480c3c9c4bb3b999f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:46.958398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e813148105af4a0480c3c9c4bb3b999f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:46.960009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e813148105af4a0480c3c9c4bb3b999f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:46.992673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-88eefe5d-b79e-4142-b685-00418c468c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e813148105af4a0480c3c9c4bb3b999f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:47.010307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 834/1668] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:20:46 2022] DELETE /identity/v3/users/e813148105af4a0480c3c9c4bb3b999f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:47.015105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.015633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.015719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.063243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:47.066868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:47.213413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 835/1669] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:47.254996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.255896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.256633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.272976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:47.276259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:47.346342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] MFA Rules not processed for user `e1a09994c5b647ab9d40a158fee62f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:47.347715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:47.436647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be88e1-cc0a-4d8a-b4e6-2f08fba48ed7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:47.457470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac83112-5c0a-4237-be55-39cf9a6744a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:47.459736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac83112-5c0a-4237-be55-39cf9a6744a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.460169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac83112-5c0a-4237-be55-39cf9a6744a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.463635 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac83112-5c0a-4237-be55-39cf9a6744a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.501034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac83112-5c0a-4237-be55-39cf9a6744a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:47.502603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac83112-5c0a-4237-be55-39cf9a6744a4 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:47.533998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 836/1670] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:20:47.603995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 835/1671] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:47.611467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5170-0533-4f2e-879e-42e46d651068 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.611766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5170-0533-4f2e-879e-42e46d651068 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.612132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d5170-0533-4f2e-879e-42e46d651068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.665223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aa6d5170-0533-4f2e-879e-42e46d651068 None None] MFA Rules not processed for user `e1a09994c5b647ab9d40a158fee62f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:47.670384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aa6d5170-0533-4f2e-879e-42e46d651068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:47.692593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 837/1672] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:47.711827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:47.713368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:47.731384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:47.897359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.897879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.898346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.900343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b167ea3-1739-4f6c-b4c7-ca91b01c3a37 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:47.923661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90623c-208c-434c-aa6b-074fdf82a463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:47.930084 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90623c-208c-434c-aa6b-074fdf82a463 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.930425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90623c-208c-434c-aa6b-074fdf82a463 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.930707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90623c-208c-434c-aa6b-074fdf82a463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:47.952867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90623c-208c-434c-aa6b-074fdf82a463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:47.954553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90623c-208c-434c-aa6b-074fdf82a463 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:47.964726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] MFA Rules not processed for user `eef6662134a14362bd6dd6d1a13b2e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:47.966374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:47.983466 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 836/1673] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:47.986007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:47.988665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352224-e2cf-4b2c-b0b4-362ccf762b35 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:47.988665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352224-e2cf-4b2c-b0b4-362ccf762b35 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:47.988936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d352224-e2cf-4b2c-b0b4-362ccf762b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.061314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4d352224-e2cf-4b2c-b0b4-362ccf762b35 None None] MFA Rules not processed for user `46c3c63c45ed4882bd7b4b70bea2f613`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:48.064686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4d352224-e2cf-4b2c-b0b4-362ccf762b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:48.114635 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 838/1674] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:48.131257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:48.133369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:48.169470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fea5c-846f-478f-bcfb-4c395cee8f81 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:48.184763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:48.185870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.186561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.187037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.209366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:48.213700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:48.241058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 839/1675] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:20:48.283651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 837/1676] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:48.539118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:48.569601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bcc77-3b39-4dfe-adf4-68b79a727c6a service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:48.607256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e9e43-824c-4a44-8cca-c7adf1d8042d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:48.609474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e9e43-824c-4a44-8cca-c7adf1d8042d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:48.611889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e9e43-824c-4a44-8cca-c7adf1d8042d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:48.612809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e9e43-824c-4a44-8cca-c7adf1d8042d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:48.657708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e9e43-824c-4a44-8cca-c7adf1d8042d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:48.660213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e9e43-824c-4a44-8cca-c7adf1d8042d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:48.681001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 840/1677] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:49.251430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2590-a317-4676-875b-1e8ce8a6c485 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.252378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2590-a317-4676-875b-1e8ce8a6c485 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.252798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f2590-a317-4676-875b-1e8ce8a6c485 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.255340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 838/1678] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 01:20:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:49.285390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.285945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.285945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.399987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] MFA Rules not processed for user `ed70b6997f064f3f8fa68dea2a6eb470`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:49.403646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:49.438560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 841/1679] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:49.447561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2590-a317-4676-875b-1e8ce8a6c485 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:49.452260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7a9f2590-a317-4676-875b-1e8ce8a6c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:49.489500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f2590-a317-4676-875b-1e8ce8a6c485 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:49.501503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2077a-9684-48cd-8c4e-579edfa2ea13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:49.502836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2077a-9684-48cd-8c4e-579edfa2ea13 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:49.505537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2077a-9684-48cd-8c4e-579edfa2ea13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:49.506232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2077a-9684-48cd-8c4e-579edfa2ea13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:49.551732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2077a-9684-48cd-8c4e-579edfa2ea13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:49.556455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2077a-9684-48cd-8c4e-579edfa2ea13 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:49.585839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 839/1680] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:50.055386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.057375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.092538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ef5b7-c920-49d4-87bd-0ad3aec2fe25 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.106546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.107502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.108192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.108614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] PATH_INFO: `/v3/projects/459c1f2b2d0442148f46cd110f168d78` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.111304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=459c1f2b2d0442148f46cd110f168d78)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.113429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.234875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '459c1f2b2d0442148f46cd110f168d78', 'request_id': 'req-1401b35e-618b-48c8-a85c-206861beff23'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:50.252711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '459c1f2b2d0442148f46cd110f168d78', 'request_id': 'req-1401b35e-618b-48c8-a85c-206861beff23'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:50.265684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '459c1f2b2d0442148f46cd110f168d78', 'request_id': 'req-1401b35e-618b-48c8-a85c-206861beff23'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:50.301287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] The token cache is being invalidate because project 459c1f2b2d0442148f46cd110f168d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:20:50.301871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:50.302401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-1401b35e-618b-48c8-a85c-206861beff23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:50.304554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 842/1681] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:20:50 2022] DELETE /identity/v3/projects/459c1f2b2d0442148f46cd110f168d78 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:50.309574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be926-ddfb-4932-b0cd-27a1b0ff6ef8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.310064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be926-ddfb-4932-b0cd-27a1b0ff6ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.310064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0be926-ddfb-4932-b0cd-27a1b0ff6ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.350708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ee0be926-ddfb-4932-b0cd-27a1b0ff6ef8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:50.352352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ee0be926-ddfb-4932-b0cd-27a1b0ff6ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.468718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1647-b34d-4abc-b18c-37915f462a60 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.470963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1647-b34d-4abc-b18c-37915f462a60 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.471759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1647-b34d-4abc-b18c-37915f462a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.554912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 840/1682] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:50.563302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df5d7-c337-4592-bd21-00ef038783cb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.563738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-69ce1647-b34d-4abc-b18c-37915f462a60 None None] MFA Rules not processed for user `bef2265fc5044f878ba35c90c24a634d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:50.563997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df5d7-c337-4592-bd21-00ef038783cb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.564410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96df5d7-c337-4592-bd21-00ef038783cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.565306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69ce1647-b34d-4abc-b18c-37915f462a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.607078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e96df5d7-c337-4592-bd21-00ef038783cb None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:50.608854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e96df5d7-c337-4592-bd21-00ef038783cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.639863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 841/1683] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:50.644639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df5d7-c337-4592-bd21-00ef038783cb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.652775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.659996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96df5d7-c337-4592-bd21-00ef038783cb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.666728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.682226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.691580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.692555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.694678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:50.697236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:50.697778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.702437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.745742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 842/1684] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:50.748048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.779089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 843/1685] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:50.780077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3d5e7-c925-4237-90d6-d1b2d4f39342 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:50.789493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.790043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.790568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.792988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:50.795631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:50.797029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:50.798468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:50.800578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:50.806406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:50.836806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] MFA Rules not processed for user `bef2265fc5044f878ba35c90c24a634d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:50.838128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.866461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 844/1686] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:50.899110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:50.900630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:50.905667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 843/1687] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:50.910680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.143459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d6ecd-f771-4faf-9acc-19df942630ce admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.158824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fd9ea-7bb8-4c97-8708-aa636002d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.159614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fd9ea-7bb8-4c97-8708-aa636002d780 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.160631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fd9ea-7bb8-4c97-8708-aa636002d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.161581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fd9ea-7bb8-4c97-8708-aa636002d780 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.163608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fd9ea-7bb8-4c97-8708-aa636002d780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.168022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fd9ea-7bb8-4c97-8708-aa636002d780 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.226195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 844/1688] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:50 2022] POST /identity/v3/users => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:51.232346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5c71f-4a3a-4ba2-b439-81d25ec263dc None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.233748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a4a87-a9a9-4017-b52e-3ded216682a0 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.249193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a4a87-a9a9-4017-b52e-3ded216682a0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.250393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a4a87-a9a9-4017-b52e-3ded216682a0 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.265352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 845/1689] 10.222.0.17 () {54 vars in 961 bytes} [Sat Aug 6 01:20:51 2022] GET /identity => generated 270 bytes in 38 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:20:51.267288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a4a87-a9a9-4017-b52e-3ded216682a0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.299460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a4a87-a9a9-4017-b52e-3ded216682a0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.314514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f624282-79c9-480d-b79a-d342f1d59b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.315743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f624282-79c9-480d-b79a-d342f1d59b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.316789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f624282-79c9-480d-b79a-d342f1d59b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.317144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f624282-79c9-480d-b79a-d342f1d59b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.319024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f624282-79c9-480d-b79a-d342f1d59b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.324140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f624282-79c9-480d-b79a-d342f1d59b59 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.370827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 846/1690] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:51.380627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf317-2ebd-45ca-aba5-579444c73fb4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.384649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf317-2ebd-45ca-aba5-579444c73fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.386703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bf317-2ebd-45ca-aba5-579444c73fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.432822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.434293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.434733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.435147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.435700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9d0bf317-2ebd-45ca-aba5-579444c73fb4 None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:51.439045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9d0bf317-2ebd-45ca-aba5-579444c73fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:51.518182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.521849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.550264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 845/1691] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:20:51.551771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.563568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.583248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59420c4f-8f5a-4658-b237-cbc869af4a2a service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.596903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.598130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.598558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.598985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.608015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.611024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.611946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 847/1692] 10.222.0.17 () {58 vars in 1058 bytes} [Sat Aug 6 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:51.614992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf317-2ebd-45ca-aba5-579444c73fb4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.645566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 846/1693] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:51.648488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bf317-2ebd-45ca-aba5-579444c73fb4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.650600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.652790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:51.656801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.657881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.658200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.658525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.661119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:51.669105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52015eeb-0217-44d3-a509-891311d91522 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.677778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.678722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.679152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.680455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] PATH_INFO: `/v3/users/9b04816cb03d48c8a723b7dcca8679e4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.681799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.683850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.685391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b04816cb03d48c8a723b7dcca8679e4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.687545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.706626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 848/1694] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:51.707276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:51.739540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b545f-2517-439d-bb48-e50bcbea880c service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:51.753185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64daa1cc-39bc-4a66-87a6-7dffc5763a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:51.755241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa1cc-39bc-4a66-87a6-7dffc5763a05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.756175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa1cc-39bc-4a66-87a6-7dffc5763a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.756175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64daa1cc-39bc-4a66-87a6-7dffc5763a05 admin admin] PATH_INFO: `/v3/projects/87c77dce5f0e4b21ba7ed51f52920eba/users/fa732330b8cb499d8e6804f2d38efb2b/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.794897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa1cc-39bc-4a66-87a6-7dffc5763a05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c77dce5f0e4b21ba7ed51f52920eba, user_id=fa732330b8cb499d8e6804f2d38efb2b, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:51.799517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64daa1cc-39bc-4a66-87a6-7dffc5763a05 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:51.800829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b04816cb03d48c8a723b7dcca8679e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:51.817558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b04816cb03d48c8a723b7dcca8679e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:51.818439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b04816cb03d48c8a723b7dcca8679e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:51.835768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 849/1695] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:51 2022] PUT /identity/v3/projects/87c77dce5f0e4b21ba7ed51f52920eba/users/fa732330b8cb499d8e6804f2d38efb2b/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:51.840993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.841275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.841555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.853315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b04816cb03d48c8a723b7dcca8679e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:51.866474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:51.875361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5211ed1c-7bf9-4a0c-93d0-c4b024674b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b04816cb03d48c8a723b7dcca8679e4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:51.901727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:51.904555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:51.911601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 847/1696] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:20:51 2022] DELETE /identity/v3/users/9b04816cb03d48c8a723b7dcca8679e4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:51.923905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:51.924191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:51.925088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:51.994329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:51.998468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:52.058550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 850/1697] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:52.093353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.096643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:52.187656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 848/1698] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:52.229581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:52.231511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:52.276216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cabdf-5f9d-482f-a21b-7b194a97c16c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.287993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5c912-644f-4c89-824d-9a4fb9ff31c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.288718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c912-644f-4c89-824d-9a4fb9ff31c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.288999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c912-644f-4c89-824d-9a4fb9ff31c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.289272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c912-644f-4c89-824d-9a4fb9ff31c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.324245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5c912-644f-4c89-824d-9a4fb9ff31c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.326844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f5c912-644f-4c89-824d-9a4fb9ff31c1 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.334167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6ea2d-2b8a-4c05-a806-d1928a63b982 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:52.344644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9402fa5-74af-4ad3-8c98-de6e9e970063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:52.345411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402fa5-74af-4ad3-8c98-de6e9e970063 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.345795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402fa5-74af-4ad3-8c98-de6e9e970063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.347099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9402fa5-74af-4ad3-8c98-de6e9e970063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.370810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 851/1699] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:52.398344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9402fa5-74af-4ad3-8c98-de6e9e970063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:52.402226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9402fa5-74af-4ad3-8c98-de6e9e970063 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:52.454990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 849/1700] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:20:52.737681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84270bf-f502-4fa3-9074-f89b2a025363 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.738550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84270bf-f502-4fa3-9074-f89b2a025363 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.739023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84270bf-f502-4fa3-9074-f89b2a025363 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.740880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 852/1701] 10.222.0.17 () {54 vars in 912 bytes} [Sat Aug 6 01:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:20:52.755648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a723b-3f2f-42d6-82dc-a8bcf3553648 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:52.756221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a723b-3f2f-42d6-82dc-a8bcf3553648 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:52.756713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a723b-3f2f-42d6-82dc-a8bcf3553648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:52.783528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:52.804476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fc7a723b-3f2f-42d6-82dc-a8bcf3553648 None None] MFA Rules not processed for user `ed70b6997f064f3f8fa68dea2a6eb470`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:52.805728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fc7a723b-3f2f-42d6-82dc-a8bcf3553648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:52.834130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 850/1702] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:53.017720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84270bf-f502-4fa3-9074-f89b2a025363 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:53.035037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84270bf-f502-4fa3-9074-f89b2a025363 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:53.046779 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:53.049248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:53.050187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:53.050924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:53.070369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:53.073281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:53.092701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 853/1703] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:20:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:20:54.614739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7499e09-2237-46b2-b79b-8f2f361e25cc None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:54.615240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7499e09-2237-46b2-b79b-8f2f361e25cc None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:54.615394 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7499e09-2237-46b2-b79b-8f2f361e25cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:54.662046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b7499e09-2237-46b2-b79b-8f2f361e25cc None None] MFA Rules not processed for user `bef2265fc5044f878ba35c90c24a634d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:54.663779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7499e09-2237-46b2-b79b-8f2f361e25cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:54.840632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 851/1704] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:54.928635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:54.930462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:54.996967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd01e0-3bfa-4cc9-839f-56947f4bf686 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.014708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.015621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.016044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.016477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] PATH_INFO: `/v3/projects/b03cd46157a04575a1350641c7131c57` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.021483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03cd46157a04575a1350641c7131c57)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.024172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: WARNING py.warnings [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 06 01:20:55.024172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: warnings.warn(msg) Aug 06 01:20:55.024172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: Aug 06 01:20:55.029392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.182098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03cd46157a04575a1350641c7131c57', 'request_id': 'req-ca430b7e-ef75-407c-93a5-24272d86e74b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.199087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03cd46157a04575a1350641c7131c57', 'request_id': 'req-ca430b7e-ef75-407c-93a5-24272d86e74b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.208037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03cd46157a04575a1350641c7131c57', 'request_id': 'req-ca430b7e-ef75-407c-93a5-24272d86e74b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.255489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac4ee-8e4a-47aa-9984-0eec9bfefe10 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.255777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac4ee-8e4a-47aa-9984-0eec9bfefe10 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.256051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ac4ee-8e4a-47aa-9984-0eec9bfefe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.302174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] The token cache is being invalidate because project b03cd46157a04575a1350641c7131c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:20:55.302478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.306619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.317811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 854/1705] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:20:54 2022] DELETE /identity/v3/projects/b03cd46157a04575a1350641c7131c57 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:55.319383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:55.327101 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:55.333395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aa2ac4ee-8e4a-47aa-9984-0eec9bfefe10 None None] MFA Rules not processed for user `46c3c63c45ed4882bd7b4b70bea2f613`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:55.334684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aa2ac4ee-8e4a-47aa-9984-0eec9bfefe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:55.426509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:55.534937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430b7e-ef75-407c-93a5-24272d86e74b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:55.540951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:55.542611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.542611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.543276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] PATH_INFO: `/v3/users/df88fae26d124d74b774956d721dfed5` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.545181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df88fae26d124d74b774956d721dfed5)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:55.548336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:55.561363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 852/1706] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:55.637797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df88fae26d124d74b774956d721dfed5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.650830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df88fae26d124d74b774956d721dfed5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.683694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df88fae26d124d74b774956d721dfed5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.687124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df88fae26d124d74b774956d721dfed5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.709224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-12469a57-3ea8-4445-9a85-7cd00c3dc7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df88fae26d124d74b774956d721dfed5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:55.737758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 855/1707] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:20:55 2022] DELETE /identity/v3/users/df88fae26d124d74b774956d721dfed5 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:55.807878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441cbd-0faf-48b1-9a7b-b76ae2e926ed None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:55.808382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441cbd-0faf-48b1-9a7b-b76ae2e926ed None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:55.808759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441cbd-0faf-48b1-9a7b-b76ae2e926ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:55.950070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-49441cbd-0faf-48b1-9a7b-b76ae2e926ed None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:55.963372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-49441cbd-0faf-48b1-9a7b-b76ae2e926ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.012004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.013078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.013078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.079005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] MFA Rules not processed for user `eef6662134a14362bd6dd6d1a13b2e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:56.079677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.166351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 853/1708] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:56.167929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.168370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.168793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.245727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] MFA Rules not processed for user `fa732330b8cb499d8e6804f2d38efb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:56.247726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.261576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.278127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 856/1709] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:56.357728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.359304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.367359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 854/1710] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:56.471531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.521070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.522859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.530563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bcb85-cb96-489b-b637-bc6fdb002582 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.551778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.552428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.552701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.552980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.553663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.556603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.644001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 857/1711] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:56 2022] POST /identity/v3/projects => generated 403 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:56.645772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:56.650073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:56.779164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678cb91-338a-422a-93e4-dea64006f1e1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.808411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169367c-0d32-4515-a8ef-b23d7925860a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:56.835396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.836086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.836363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.836638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] PATH_INFO: `/v3/projects/efbdfc6d54b4411da5fba060f66c8358` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.839470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbdfc6d54b4411da5fba060f66c8358)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:56.841435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:56.876096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dacc4-acbd-4849-9e0e-ed99cc6b29ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:56.876737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dacc4-acbd-4849-9e0e-ed99cc6b29ed service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:56.877017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dacc4-acbd-4849-9e0e-ed99cc6b29ed service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:56.877289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dacc4-acbd-4849-9e0e-ed99cc6b29ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:56.958859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbdfc6d54b4411da5fba060f66c8358', 'request_id': 'req-aa418510-1e17-4f68-98be-67bdac0fd3a6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:56.981872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbdfc6d54b4411da5fba060f66c8358', 'request_id': 'req-aa418510-1e17-4f68-98be-67bdac0fd3a6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:56.984736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:56.989349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbdfc6d54b4411da5fba060f66c8358', 'request_id': 'req-aa418510-1e17-4f68-98be-67bdac0fd3a6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:57.012696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] The token cache is being invalidate because project efbdfc6d54b4411da5fba060f66c8358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:20:57.013415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:57.018402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:57.020978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 858/1712] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:20:56 2022] DELETE /identity/v3/projects/efbdfc6d54b4411da5fba060f66c8358 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:57.025640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.027095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dacc4-acbd-4849-9e0e-ed99cc6b29ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.029079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dacc4-acbd-4849-9e0e-ed99cc6b29ed service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.030936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:57.053789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 855/1713] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:20:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 01:20:57.053789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746f64-a61e-448e-b6fa-f61aa279c4c1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.053789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746f64-a61e-448e-b6fa-f61aa279c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.053789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e746f64-a61e-448e-b6fa-f61aa279c4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.123493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8e746f64-a61e-448e-b6fa-f61aa279c4c1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:57.131285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8e746f64-a61e-448e-b6fa-f61aa279c4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:57.193711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa418510-1e17-4f68-98be-67bdac0fd3a6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.237117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.247141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.247141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.247141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.247141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.247141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.320121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:57.337574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 856/1714] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:57.345597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2528-13e6-4327-82c1-de56815633d6 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.346042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2528-13e6-4327-82c1-de56815633d6 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.346286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2528-13e6-4327-82c1-de56815633d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.377187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 859/1715] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:57 2022] POST /identity/v3/users => generated 308 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:57.379094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.411421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50867a-1440-4730-a2c7-3e0062455da9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.414619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-39ec2528-13e6-4327-82c1-de56815633d6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:57.418822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-39ec2528-13e6-4327-82c1-de56815633d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:57.444405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.445091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.445381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.445681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.452111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 857/1716] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:57.454362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2528-13e6-4327-82c1-de56815633d6 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.454900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.456658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.486895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2528-13e6-4327-82c1-de56815633d6 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.492775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 860/1717] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:57.501867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.533428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.535473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.535866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.536162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.548166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:20:57.550226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.556456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.559875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bea10e-5f8f-4ca7-933c-3785770b8851 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.587871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.588537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.588814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.589089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] PATH_INFO: `/v3/projects/f916800272a64a57a0aa41bc452f9aef/users/978a5afdcf5142a8939c640258dfc6df/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.600457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 858/1718] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:20:57.604808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.631700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796155d9-6253-49b6-aa5a-e4fe18031c9e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:57.643882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:57.644827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:57.645421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:57.646625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:57.649827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.655352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.681055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f916800272a64a57a0aa41bc452f9aef, user_id=978a5afdcf5142a8939c640258dfc6df, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:57.683903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:57.724502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 861/1719] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:57 2022] PUT /identity/v3/projects/f916800272a64a57a0aa41bc452f9aef/users/978a5afdcf5142a8939c640258dfc6df/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:57.734553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:57.810380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 859/1720] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:57 2022] POST /identity/v3/projects => generated 365 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:57.814615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.008354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d480d7-5597-4342-bc20-74df2647ad2c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.028990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.031452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.034958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e8060-66ef-41a0-afe9-ec1fc8c8e8b9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.035613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.036308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.037819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.039628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.055280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.056253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.056483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.056764 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.057452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.059865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.070169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 862/1721] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:58.074655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.091181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0435f9e-b03d-4ec6-97b5-8e4f89bb73a2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.104509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 860/1722] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:57 2022] POST /identity/v3/users => generated 283 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:20:58.105179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.105882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.106179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.106454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] PATH_INFO: `/v3/projects/f916800272a64a57a0aa41bc452f9aef/users/978a5afdcf5142a8939c640258dfc6df/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.109962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.124228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f916800272a64a57a0aa41bc452f9aef, user_id=978a5afdcf5142a8939c640258dfc6df, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.137524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.146812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3f91-b245-43ec-ae15-90c5b1c7ff3e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.164280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.165238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.165648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.166120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.166981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.167404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 863/1723] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:58 2022] PUT /identity/v3/projects/f916800272a64a57a0aa41bc452f9aef/users/978a5afdcf5142a8939c640258dfc6df/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:20:58.169433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.185685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.192273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 861/1724] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:58.347019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba988-c195-4fa5-8082-9c096a690c2c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.362022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86c796-82e0-4b61-aeb0-90ba42409f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.363828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c796-82e0-4b61-aeb0-90ba42409f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.364118 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c796-82e0-4b61-aeb0-90ba42409f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.364396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86c796-82e0-4b61-aeb0-90ba42409f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.365965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86c796-82e0-4b61-aeb0-90ba42409f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.372186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86c796-82e0-4b61-aeb0-90ba42409f8d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.411373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 864/1725] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:20:58.413264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:58.430809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d1531-00ff-4e94-87c6-0308942bf1ae admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:58.444541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:58.445053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.445331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.445606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] PATH_INFO: `/v3/projects/62405c5d86af45db8f4c5bd613359823/users/dfa5358c75a94d338d2cd7db08682847/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.505111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.539199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62405c5d86af45db8f4c5bd613359823, user_id=dfa5358c75a94d338d2cd7db08682847, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:58.542128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:58.628617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 862/1726] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:20:58 2022] PUT /identity/v3/projects/62405c5d86af45db8f4c5bd613359823/users/dfa5358c75a94d338d2cd7db08682847/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:20:58.640342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:58.640657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:58.641025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:58.787079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] MFA Rules not processed for user `dfa5358c75a94d338d2cd7db08682847`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:58.788715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:58.831123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:20:58.952874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 865/1727] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:20:58.957602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.234013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2c485-4fe0-4eb5-8734-3a2c4a29c4d3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.260741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736342-645d-476e-95d3-922885976b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.265702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736342-645d-476e-95d3-922885976b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.267113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736342-645d-476e-95d3-922885976b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.269295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35736342-645d-476e-95d3-922885976b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.271824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35736342-645d-476e-95d3-922885976b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.279735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35736342-645d-476e-95d3-922885976b2a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.298273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.301146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:59.347942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52687d94-28ff-452f-a91e-12d56f07d23a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.397909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.414607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.415168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.416306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] PATH_INFO: `/v3/users/1788980004f24fb99dda54ac60c13808` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.418105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1788980004f24fb99dda54ac60c13808)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.421041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.430329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 863/1728] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:20:58 2022] POST /identity/v3/projects => generated 365 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:59.433649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736342-645d-476e-95d3-922885976b2a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.585332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1788980004f24fb99dda54ac60c13808'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:59.610180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1788980004f24fb99dda54ac60c13808'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:59.611132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35736342-645d-476e-95d3-922885976b2a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.655187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1788980004f24fb99dda54ac60c13808'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:59.656277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1788980004f24fb99dda54ac60c13808'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:59.659365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.660881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.663218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.665164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.668378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.671377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-74ae5f7c-2f43-44af-9fd6-83b5e2a51081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1788980004f24fb99dda54ac60c13808'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:20:59.678304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:20:59.688755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 866/1729] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:20:59 2022] DELETE /identity/v3/users/1788980004f24fb99dda54ac60c13808 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:20:59.693971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f03ed-5964-4cc8-8b4e-50ca516a3620 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.694727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f03ed-5964-4cc8-8b4e-50ca516a3620 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.695340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f03ed-5964-4cc8-8b4e-50ca516a3620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.751989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9c0f03ed-5964-4cc8-8b4e-50ca516a3620 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:20:59.756982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9c0f03ed-5964-4cc8-8b4e-50ca516a3620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:59.794729 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 864/1730] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:20:59 2022] POST /identity/v3/users => generated 289 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:20:59.799341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:20:59.806447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:20:59.911058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070dc22c-414b-497f-a875-e0cfc419cc79 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:20:59.926679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 867/1731] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:20:59.932644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:20:59.934707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:20:59.934970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:20:59.935552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:20:59.941372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:20:59.947948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.007280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f03ed-5964-4cc8-8b4e-50ca516a3620 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.009549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 865/1732] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:00.030721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f03ed-5964-4cc8-8b4e-50ca516a3620 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.031078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.033865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:00.092369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.093349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.093635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.093917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] PATH_INFO: `/v3/projects/21e5484e86084d49b03773b9cdaa7acc/users/a1e40aebb49f4c48a8d5c2d330c5de28/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.166758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e5484e86084d49b03773b9cdaa7acc, user_id=a1e40aebb49f4c48a8d5c2d330c5de28, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.170910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.225881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 868/1733] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:00 2022] PUT /identity/v3/projects/21e5484e86084d49b03773b9cdaa7acc/users/a1e40aebb49f4c48a8d5c2d330c5de28/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:00.230488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.325012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:00.343079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8040bfb-4021-4f7c-83a0-043eb4f81625 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.356705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:00.511877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c772cc-e1a6-43ee-b557-2126e8c54da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.512586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c772cc-e1a6-43ee-b557-2126e8c54da2 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.512873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c772cc-e1a6-43ee-b557-2126e8c54da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.513151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c772cc-e1a6-43ee-b557-2126e8c54da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.676170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00665db1-833c-4cae-881b-aaf88a3ebb04 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.681627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.682334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.682622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.682900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.683715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.685605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.701741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c772cc-e1a6-43ee-b557-2126e8c54da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.704283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 869/1734] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 474 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:00.710395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c772cc-e1a6-43ee-b557-2126e8c54da2 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.713767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:00.734814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 866/1735] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:00.768031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b637f0-7fe0-4e85-8595-d2580a8d5536 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:00.786250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:00.787127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.787414 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.788483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] PATH_INFO: `/v3/projects/21e5484e86084d49b03773b9cdaa7acc/users/a1e40aebb49f4c48a8d5c2d330c5de28/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.792255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e5484e86084d49b03773b9cdaa7acc, user_id=a1e40aebb49f4c48a8d5c2d330c5de28, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:00.800731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:00.844529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 870/1736] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:00 2022] PUT /identity/v3/projects/21e5484e86084d49b03773b9cdaa7acc/users/a1e40aebb49f4c48a8d5c2d330c5de28/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:00.858346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766d84-e46d-4099-bd6c-30a72df8fa2a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:00.859297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766d84-e46d-4099-bd6c-30a72df8fa2a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:00.859726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e766d84-e46d-4099-bd6c-30a72df8fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:00.956311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0e766d84-e46d-4099-bd6c-30a72df8fa2a None None] MFA Rules not processed for user `a1e40aebb49f4c48a8d5c2d330c5de28`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:00.958062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e766d84-e46d-4099-bd6c-30a72df8fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:01.228102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 867/1737] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:00 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:01.233428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.235513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:01.417762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11ca6-116d-4899-8eb1-b584b61f1540 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.418317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11ca6-116d-4899-8eb1-b584b61f1540 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.418709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e11ca6-116d-4899-8eb1-b584b61f1540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.495768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-91e11ca6-116d-4899-8eb1-b584b61f1540 None None] MFA Rules not processed for user `ed70b6997f064f3f8fa68dea2a6eb470`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:01.502805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-91e11ca6-116d-4899-8eb1-b584b61f1540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:01.574133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2724bb9-b24c-427a-b29e-d14d1ba38b4a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.591094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.596251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.598239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.600800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.635959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:01.638909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:01.681326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:01.699518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 871/1738] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:01.738335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 868/1739] 10.222.0.30 () {58 vars in 1015 bytes} [Sat Aug 6 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:01.896373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.907146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f5d3a-426b-4713-be92-f2fd4f5f016a service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:01.921615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:01.922293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:01.922568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:01.922836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:01.935101 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:01.973952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e11ca6-116d-4899-8eb1-b584b61f1540 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:01.986265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e11ca6-116d-4899-8eb1-b584b61f1540 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.007116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.007788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.008059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.010154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.029842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.033849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.046009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 869/1740] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:02.213112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.219728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:02.265186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 872/1741] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:02.718432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:02.720712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:02.953894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf31f-8741-4512-a92e-8b46671e18a1 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:02.975649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:02.977852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:02.978374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:02.980560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] PATH_INFO: `/v3/projects/a56ea9da94224144b979d29e1532b955` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:02.984256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56ea9da94224144b979d29e1532b955)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:02.997602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.172946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56ea9da94224144b979d29e1532b955', 'request_id': 'req-cde630ac-f64b-4c95-b071-b7d0dc0baee6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.188695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56ea9da94224144b979d29e1532b955', 'request_id': 'req-cde630ac-f64b-4c95-b071-b7d0dc0baee6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.204509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56ea9da94224144b979d29e1532b955', 'request_id': 'req-cde630ac-f64b-4c95-b071-b7d0dc0baee6'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.230854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] The token cache is being invalidate because project a56ea9da94224144b979d29e1532b955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:03.231527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.232430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-cde630ac-f64b-4c95-b071-b7d0dc0baee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.239965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 870/1742] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:02 2022] DELETE /identity/v3/projects/a56ea9da94224144b979d29e1532b955 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:03.241110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:03.260981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228be942-559e-4c40-87db-e3dee57eadd0 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:03.366733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:03.464874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:03.469140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.470094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.472808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] PATH_INFO: `/v3/users/4a917040d7fc4a9ab286880fb849c022` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.478554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a917040d7fc4a9ab286880fb849c022)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:03.485128 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:03.659430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a917040d7fc4a9ab286880fb849c022'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.677438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a917040d7fc4a9ab286880fb849c022'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.706231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a917040d7fc4a9ab286880fb849c022'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.710112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a917040d7fc4a9ab286880fb849c022'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.726986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f7ca31f7-aa6f-41ec-a7ec-82b27e176f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a917040d7fc4a9ab286880fb849c022'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:03.742015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 873/1743] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:03 2022] DELETE /identity/v3/users/4a917040d7fc4a9ab286880fb849c022 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:03.869882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9aeb-9630-4bf4-9e50-4986272cfd93 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:03.869882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9aeb-9630-4bf4-9e50-4986272cfd93 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:03.869882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9aeb-9630-4bf4-9e50-4986272cfd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:03.942962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f27a9aeb-9630-4bf4-9e50-4986272cfd93 None None] MFA Rules not processed for user `978a5afdcf5142a8939c640258dfc6df`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:03.945300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f27a9aeb-9630-4bf4-9e50-4986272cfd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:04.220556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:04.256023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 871/1744] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:06.149485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deceeab-db5e-466c-8153-a44c442358ee None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:06.150115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deceeab-db5e-466c-8153-a44c442358ee None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:06.150221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deceeab-db5e-466c-8153-a44c442358ee None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:06.152707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 874/1745] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:21:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:06.183554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:06.184154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:06.184391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:06.224346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:06.225767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:06.453842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 872/1746] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:06.482975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deceeab-db5e-466c-8153-a44c442358ee None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:06.483640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7deceeab-db5e-466c-8153-a44c442358ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:06.560656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:06.567690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:06.583890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deceeab-db5e-466c-8153-a44c442358ee None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:06.605975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9647b-d8ef-48c2-ab83-5e2c70a6c7b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:06.606709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9647b-d8ef-48c2-ab83-5e2c70a6c7b7 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:06.607060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9647b-d8ef-48c2-ab83-5e2c70a6c7b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:06.607343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9647b-d8ef-48c2-ab83-5e2c70a6c7b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:06.646201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9647b-d8ef-48c2-ab83-5e2c70a6c7b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:06.648082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9647b-d8ef-48c2-ab83-5e2c70a6c7b7 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:06.674673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 875/1747] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:06.869171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8c82c-f5c0-44c8-bb84-59418d8c9ab8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:06.896047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:06.896047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:06.896047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:06.896047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] PATH_INFO: `/v3/projects/a0ee1986c97f448ca65f9e448becd6a2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:06.897355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ee1986c97f448ca65f9e448becd6a2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:06.918340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.109713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ee1986c97f448ca65f9e448becd6a2', 'request_id': 'req-87d9cf18-57aa-4c59-b654-3cb563395c2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:07.131938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ee1986c97f448ca65f9e448becd6a2', 'request_id': 'req-87d9cf18-57aa-4c59-b654-3cb563395c2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:07.141134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ee1986c97f448ca65f9e448becd6a2', 'request_id': 'req-87d9cf18-57aa-4c59-b654-3cb563395c2d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:07.168594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] The token cache is being invalidate because project a0ee1986c97f448ca65f9e448becd6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:07.169329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:07.173311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-87d9cf18-57aa-4c59-b654-3cb563395c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:07.175456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 873/1748] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:06 2022] DELETE /identity/v3/projects/a0ee1986c97f448ca65f9e448becd6a2 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:07.183422 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ebd74-1edb-4f1a-bde7-601cac743372 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.184573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ebd74-1edb-4f1a-bde7-601cac743372 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.185301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ebd74-1edb-4f1a-bde7-601cac743372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.226616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-394ebd74-1edb-4f1a-bde7-601cac743372 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:07.229123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-394ebd74-1edb-4f1a-bde7-601cac743372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:07.376765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 876/1749] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:07.388495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e47e-08d8-4628-b79c-ceb8362b9342 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.389037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e47e-08d8-4628-b79c-ceb8362b9342 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.389037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e47e-08d8-4628-b79c-ceb8362b9342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.429856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9d53e47e-08d8-4628-b79c-ceb8362b9342 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:07.431325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9d53e47e-08d8-4628-b79c-ceb8362b9342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:07.459379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 874/1750] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:07.464270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ebd74-1edb-4f1a-bde7-601cac743372 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.497961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ebd74-1edb-4f1a-bde7-601cac743372 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.509488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.510251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.510542 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.510867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.511638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:07.511946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.513713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.556670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 877/1751] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:07.561215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e47e-08d8-4628-b79c-ceb8362b9342 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.577271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e47e-08d8-4628-b79c-ceb8362b9342 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.583473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.584500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.585669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.586332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.587657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.589913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.619676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.661585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 875/1752] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:07 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:07.665554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.683972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772554b-2bdc-4696-8008-8c8e26060db9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:07.782994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:07.878694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:07.879359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:07.879636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:07.879909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:07.880595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:07.882568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:07.954798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 878/1753] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:07 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:07.959115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:07.991517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6906f9e-7fd9-406b-a881-3745a4d3decb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.026514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.031424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.033963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.043297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.044362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.049646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.094189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 876/1754] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:08.095582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.112309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee6171-ddf8-4665-ad69-14cf7b94cbcf admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.151117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5525008f-450e-4d6f-a185-aa5bd96dc875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.151622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525008f-450e-4d6f-a185-aa5bd96dc875 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.151901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525008f-450e-4d6f-a185-aa5bd96dc875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.152176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525008f-450e-4d6f-a185-aa5bd96dc875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.152940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525008f-450e-4d6f-a185-aa5bd96dc875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.157945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5525008f-450e-4d6f-a185-aa5bd96dc875 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.189724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 879/1755] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:08.194389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.210740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afbf02-1142-4f89-8357-a9c9ac41e2c8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.224863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.226736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.229447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.229987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] PATH_INFO: `/v3/projects/9f892796a5804f46913b2dcc3eb2f9ae/users/5443eae93c2a4330953c837c269d3a1a/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.309334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f892796a5804f46913b2dcc3eb2f9ae, user_id=5443eae93c2a4330953c837c269d3a1a, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.316348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:08.393016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 877/1756] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:08 2022] PUT /identity/v3/projects/9f892796a5804f46913b2dcc3eb2f9ae/users/5443eae93c2a4330953c837c269d3a1a/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:08.406103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5391c8-91f5-4971-a56f-edd15a78e203 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.406867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5391c8-91f5-4971-a56f-edd15a78e203 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.407403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5391c8-91f5-4971-a56f-edd15a78e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.528079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fa5391c8-91f5-4971-a56f-edd15a78e203 None None] MFA Rules not processed for user `5443eae93c2a4330953c837c269d3a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:08.530578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fa5391c8-91f5-4971-a56f-edd15a78e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:08.695021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 880/1757] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:08.699456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:08.943385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fd15c-8616-47fb-a5e2-395c6b66833b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:08.980338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:08.981673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:08.981673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:08.981673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:08.982575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:08.984430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.073666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 878/1758] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:08 2022] POST /identity/v3/projects => generated 387 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:09.078085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5391c8-91f5-4971-a56f-edd15a78e203 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.095914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5391c8-91f5-4971-a56f-edd15a78e203 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.277469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.278379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.278661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.280441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.281256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.286165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.349042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 881/1759] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:09 2022] POST /identity/v3/users => generated 300 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:09.353075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.373223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59148baf-f297-4e96-9ef7-dce6c4ae7f3a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.396995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.398103 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.398533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.399039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.400043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.402120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.433177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 879/1760] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:09.435025 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.455269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef848498-72fc-4fee-8547-eb28723e6cb3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.470130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.471364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.471875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.472370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] PATH_INFO: `/v3/projects/caefdcaefb3d4e8d844b35f998f53004/users/faaaaa49d24d43fd84fbaad319ccf8c4/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.519441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=caefdcaefb3d4e8d844b35f998f53004, user_id=faaaaa49d24d43fd84fbaad319ccf8c4, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.523407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.578536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.582142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 882/1761] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:09 2022] PUT /identity/v3/projects/caefdcaefb3d4e8d844b35f998f53004/users/faaaaa49d24d43fd84fbaad319ccf8c4/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:09.600278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47450762-fc63-4a68-836d-c4f6d2ca1117 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.776806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87293f92-d3ed-474d-9d59-2a6f1a4f2a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.777739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87293f92-d3ed-474d-9d59-2a6f1a4f2a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.784240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87293f92-d3ed-474d-9d59-2a6f1a4f2a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.786122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87293f92-d3ed-474d-9d59-2a6f1a4f2a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.787287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87293f92-d3ed-474d-9d59-2a6f1a4f2a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.798623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87293f92-d3ed-474d-9d59-2a6f1a4f2a50 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.822422 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:09.827573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 880/1762] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:09.831172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:09.838469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd5635-a75b-419b-86b8-830dbcc67e7e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:09.851688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff32028-c10c-4405-91ab-8713e37d9982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:09.852667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32028-c10c-4405-91ab-8713e37d9982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.867354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32028-c10c-4405-91ab-8713e37d9982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.868008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff32028-c10c-4405-91ab-8713e37d9982 admin admin] PATH_INFO: `/v3/projects/caefdcaefb3d4e8d844b35f998f53004/users/faaaaa49d24d43fd84fbaad319ccf8c4/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:09.874844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff32028-c10c-4405-91ab-8713e37d9982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caefdcaefb3d4e8d844b35f998f53004, user_id=faaaaa49d24d43fd84fbaad319ccf8c4, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:09.878510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff32028-c10c-4405-91ab-8713e37d9982 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:09.911695 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 883/1763] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:09 2022] PUT /identity/v3/projects/caefdcaefb3d4e8d844b35f998f53004/users/faaaaa49d24d43fd84fbaad319ccf8c4/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:09.923204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:09.927844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:09.928469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.004832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] MFA Rules not processed for user `faaaaa49d24d43fd84fbaad319ccf8c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:10.006350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:10.057642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:10.099499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64666-71d5-49a3-a8a0-632fa6dd2cd1 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.099863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64666-71d5-49a3-a8a0-632fa6dd2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.100386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e64666-71d5-49a3-a8a0-632fa6dd2cd1 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.102501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 884/1764] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:21:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:10.152391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.152772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.153100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.209223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:10.214800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:10.277612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 881/1765] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:10.425329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.427770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:10.548364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 885/1766] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:10.667121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d8660-c57a-47d9-92b3-52ca2aa11c94 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:10.672039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:10.672977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:10.673413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:10.673877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:10.685250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:10.687223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:10.705954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 882/1767] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:10 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:10.972959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:10.974876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:11.001527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3210808-9c9d-41c6-8c15-5ee4936fe24f None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:11.015360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2e1e6-52cc-4193-817b-e52ecd624318 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.016556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e1e6-52cc-4193-817b-e52ecd624318 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.017061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e1e6-52cc-4193-817b-e52ecd624318 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.017649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2e1e6-52cc-4193-817b-e52ecd624318 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.046944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2e1e6-52cc-4193-817b-e52ecd624318 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.049790 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2e1e6-52cc-4193-817b-e52ecd624318 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.081326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 886/1768] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:11.159368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:11.340799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fea34e-ddf5-428b-9426-8a605346dc03 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:11.349979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.351035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.351535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.352054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] PATH_INFO: `/v3/users/5443eae93c2a4330953c837c269d3a1a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.353768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5443eae93c2a4330953c837c269d3a1a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.355883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.421883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5443eae93c2a4330953c837c269d3a1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:11.438689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:11.441141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5443eae93c2a4330953c837c269d3a1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:11.442443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5443eae93c2a4330953c837c269d3a1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:11.460532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5443eae93c2a4330953c837c269d3a1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:11.479790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5443eae93c2a4330953c837c269d3a1a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:11.488095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 883/1769] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:11 2022] DELETE /identity/v3/users/5443eae93c2a4330953c837c269d3a1a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:11.509308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0c070-a127-4fe6-be67-b75e8b2f35f0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.509599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0c070-a127-4fe6-be67-b75e8b2f35f0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.509875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0c070-a127-4fe6-be67-b75e8b2f35f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.547579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-aee0c070-a127-4fe6-be67-b75e8b2f35f0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:11.549336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aee0c070-a127-4fe6-be67-b75e8b2f35f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:11.660800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 887/1770] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:11.703070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:11.704510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:11.796077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e8cf-1b25-4c48-9889-6ce68500c38c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:11.802304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:11.803210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:11.803619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:11.804102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:11.818177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:11.819691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:11.831325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 884/1771] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:12.166146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6e61-99cb-4642-87d2-f9938e727434 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.166490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6e61-99cb-4642-87d2-f9938e727434 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.166968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef6e61-99cb-4642-87d2-f9938e727434 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.170938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 888/1772] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:21:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:12.188431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.191350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.221570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.222204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.223331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.233755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37eb1f-289a-4f9e-b9cb-e3e7ed82fb31 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.252786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.253312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] MFA Rules not processed for user `aeb7cecc526443cb9d854c7104a79a66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:12.254765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.255060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.255246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.255547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] PATH_INFO: `/v3/users/dfa5358c75a94d338d2cd7db08682847` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.277639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa5358c75a94d338d2cd7db08682847)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:12.286582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:12.412480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 889/1773] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:12.413659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.417143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.427379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa5358c75a94d338d2cd7db08682847'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.437333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f2ded-dd3d-49b4-933c-e810e50118a1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.442110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa5358c75a94d338d2cd7db08682847'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.443900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa5358c75a94d338d2cd7db08682847'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.444063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.444980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.445554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.445945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] PATH_INFO: `/v3/users/fa732330b8cb499d8e6804f2d38efb2b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.447887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa732330b8cb499d8e6804f2d38efb2b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:12.450419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:12.453531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:12.462786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa5358c75a94d338d2cd7db08682847'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.476189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa5358c75a94d338d2cd7db08682847'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.514733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 885/1774] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:12 2022] DELETE /identity/v3/users/dfa5358c75a94d338d2cd7db08682847 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:12.514733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.514733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.570871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa732330b8cb499d8e6804f2d38efb2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.584664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa732330b8cb499d8e6804f2d38efb2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.603258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:12.610674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa732330b8cb499d8e6804f2d38efb2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.612522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa732330b8cb499d8e6804f2d38efb2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.624091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ed165392-219e-4660-a3b6-9ee8eaf2fec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa732330b8cb499d8e6804f2d38efb2b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:12.637174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 890/1775] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:12 2022] DELETE /identity/v3/users/fa732330b8cb499d8e6804f2d38efb2b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:12.640262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c40ad-3cc5-4907-bfc8-8a3c355a70ae None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.641446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c40ad-3cc5-4907-bfc8-8a3c355a70ae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.642183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c40ad-3cc5-4907-bfc8-8a3c355a70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.661697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22584aa8-c491-4e5d-9056-fbce34353299 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:12.670822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f26c40ad-3cc5-4907-bfc8-8a3c355a70ae None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:12.674565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f26c40ad-3cc5-4907-bfc8-8a3c355a70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.826789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 891/1776] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:12.842107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b29c5-c8dc-4723-9624-61a6f354c66e None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.842429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b29c5-c8dc-4723-9624-61a6f354c66e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.842846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b29c5-c8dc-4723-9624-61a6f354c66e None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.844359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 892/1777] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:21:12.851454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe76a3b-b556-467b-b792-40b523053480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:12.852210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe76a3b-b556-467b-b792-40b523053480 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.852491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe76a3b-b556-467b-b792-40b523053480 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.852759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe76a3b-b556-467b-b792-40b523053480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.854960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bbe76a3b-b556-467b-b792-40b523053480 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.865524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b29c5-c8dc-4723-9624-61a6f354c66e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:12.868721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-880b29c5-c8dc-4723-9624-61a6f354c66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:12.877309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe76a3b-b556-467b-b792-40b523053480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:12.880704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe76a3b-b556-467b-b792-40b523053480 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:12.902263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 886/1778] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:12.905910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:12.906455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:12.907097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:12.983822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:12.987031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.010207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b29c5-c8dc-4723-9624-61a6f354c66e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.021866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.022680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.023050 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.023415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.039285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.041487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.052613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 893/1779] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:13.053687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.055337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.072855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f275d612-3e43-45f7-be03-e738a1a80228 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.083575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.084429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 887/1780] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:13.085334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.085334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.085334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] PATH_INFO: `/v3/projects/9f892796a5804f46913b2dcc3eb2f9ae` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.087035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f892796a5804f46913b2dcc3eb2f9ae)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.089287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.112498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.158663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.161113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.182233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01815bc-3c46-4803-b7f4-4efd13788334 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.184665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f892796a5804f46913b2dcc3eb2f9ae', 'request_id': 'req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.202148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f892796a5804f46913b2dcc3eb2f9ae', 'request_id': 'req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.219535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f892796a5804f46913b2dcc3eb2f9ae', 'request_id': 'req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.252796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] The token cache is being invalidate because project 9f892796a5804f46913b2dcc3eb2f9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:13.253100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.253799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.255930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 894/1781] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:13 2022] DELETE /identity/v3/projects/9f892796a5804f46913b2dcc3eb2f9ae => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:13.257210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.267929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.329045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.330757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.331273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.331934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.334308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.349541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.353523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.356405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.375268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 888/1782] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:13.389554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.395843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.400552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea51ab5-11c6-4dee-824a-b1e97afddb0d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.407121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.407809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.408092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.408368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] PATH_INFO: `/v3/projects/87c77dce5f0e4b21ba7ed51f52920eba` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.410023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c77dce5f0e4b21ba7ed51f52920eba)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.412957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.454953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04d701-d1d6-4ceb-8fa5-1af711e87c44 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.472658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.476264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.476415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.477232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] PATH_INFO: `/v3/users/faaaaa49d24d43fd84fbaad319ccf8c4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.480071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faaaaa49d24d43fd84fbaad319ccf8c4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.485570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.501941 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c77dce5f0e4b21ba7ed51f52920eba', 'request_id': 'req-8bd58243-fa60-4933-9b95-4837822d4635'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.519773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c77dce5f0e4b21ba7ed51f52920eba', 'request_id': 'req-8bd58243-fa60-4933-9b95-4837822d4635'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.527810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c77dce5f0e4b21ba7ed51f52920eba', 'request_id': 'req-8bd58243-fa60-4933-9b95-4837822d4635'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.553306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] The token cache is being invalidate because project 87c77dce5f0e4b21ba7ed51f52920eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:13.553715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.554569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.556580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 895/1783] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:13 2022] DELETE /identity/v3/projects/87c77dce5f0e4b21ba7ed51f52920eba => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:13.560820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:13.562612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:13.591587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faaaaa49d24d43fd84fbaad319ccf8c4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.621974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:13.623159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faaaaa49d24d43fd84fbaad319ccf8c4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.624013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faaaaa49d24d43fd84fbaad319ccf8c4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.657055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd58243-fa60-4933-9b95-4837822d4635 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:13.660407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faaaaa49d24d43fd84fbaad319ccf8c4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.664393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:13.665106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:13.665426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:13.666301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] PATH_INFO: `/v3/users/978a5afdcf5142a8939c640258dfc6df` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:13.668344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=978a5afdcf5142a8939c640258dfc6df)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:13.670934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:13.676335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faaaaa49d24d43fd84fbaad319ccf8c4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.703769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 889/1784] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:13 2022] DELETE /identity/v3/users/faaaaa49d24d43fd84fbaad319ccf8c4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:13.750959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978a5afdcf5142a8939c640258dfc6df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.764845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978a5afdcf5142a8939c640258dfc6df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.791621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978a5afdcf5142a8939c640258dfc6df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.792903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978a5afdcf5142a8939c640258dfc6df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.810356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978a5afdcf5142a8939c640258dfc6df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:13.821353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 896/1785] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:13 2022] DELETE /identity/v3/users/978a5afdcf5142a8939c640258dfc6df => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:14.489239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.490991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:14.529889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.531751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:14.642882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19aa390-99dd-499f-abe8-2f177c66e6b7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.650789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989895c-12bb-42b8-a7bc-6f06a7caa207 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.659153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.659847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.660125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.660396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] PATH_INFO: `/v3/projects/62405c5d86af45db8f4c5bd613359823` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.661324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.662237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.662897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.663441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] PATH_INFO: `/v3/projects/f916800272a64a57a0aa41bc452f9aef` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.665107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62405c5d86af45db8f4c5bd613359823)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.665248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f916800272a64a57a0aa41bc452f9aef)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.667097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.667400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.734782 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62405c5d86af45db8f4c5bd613359823', 'request_id': 'req-c2996d17-d425-4ae3-881a-7848268b3ba6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.735459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f916800272a64a57a0aa41bc452f9aef', 'request_id': 'req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.751553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f916800272a64a57a0aa41bc452f9aef', 'request_id': 'req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.755139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62405c5d86af45db8f4c5bd613359823', 'request_id': 'req-c2996d17-d425-4ae3-881a-7848268b3ba6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.758172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.761098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f916800272a64a57a0aa41bc452f9aef', 'request_id': 'req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.764096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62405c5d86af45db8f4c5bd613359823', 'request_id': 'req-c2996d17-d425-4ae3-881a-7848268b3ba6'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.769968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:14.778775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] The token cache is being invalidate because project f916800272a64a57a0aa41bc452f9aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:14.779519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.780275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.782384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 890/1786] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:14 2022] DELETE /identity/v3/projects/f916800272a64a57a0aa41bc452f9aef => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:14.783703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.785251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:14.789869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] The token cache is being invalidate because project 62405c5d86af45db8f4c5bd613359823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:14.790193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.790851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c2996d17-d425-4ae3-881a-7848268b3ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.794561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 897/1787] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:14 2022] DELETE /identity/v3/projects/62405c5d86af45db8f4c5bd613359823 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:14.794561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.794561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.794855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.816771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:14.818333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:14.857890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e0cfb3-4756-4a7c-877d-d428fdcf50c5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.862586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.863243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.863525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.863844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] PATH_INFO: `/v3/projects/caefdcaefb3d4e8d844b35f998f53004` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.865051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caefdcaefb3d4e8d844b35f998f53004)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.867043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.877158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 898/1788] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:14.878111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:14.880035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:14.891871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1684a07-5bb4-4c1f-813b-711d3348b039 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:14.896932 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:14.897598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.897877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.898183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] PATH_INFO: `/v3/users/a1e40aebb49f4c48a8d5c2d330c5de28` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.899418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e40aebb49f4c48a8d5c2d330c5de28)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:14.901390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:14.915869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caefdcaefb3d4e8d844b35f998f53004', 'request_id': 'req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.924159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caefdcaefb3d4e8d844b35f998f53004', 'request_id': 'req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.930112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caefdcaefb3d4e8d844b35f998f53004', 'request_id': 'req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.942522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] The token cache is being invalidate because project caefdcaefb3d4e8d844b35f998f53004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:14.942805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.943444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a04d625-bbd3-46a7-9c34-6ca7fb083b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.945001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 891/1789] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:14 2022] DELETE /identity/v3/projects/caefdcaefb3d4e8d844b35f998f53004 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:14.948526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf8a0-c141-4d4c-9928-7d9591f5bca7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.948526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf8a0-c141-4d4c-9928-7d9591f5bca7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.948526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cf8a0-c141-4d4c-9928-7d9591f5bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:14.953217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e40aebb49f4c48a8d5c2d330c5de28'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.962071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e40aebb49f4c48a8d5c2d330c5de28'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.966604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-979cf8a0-c141-4d4c-9928-7d9591f5bca7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:14.967804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-979cf8a0-c141-4d4c-9928-7d9591f5bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:14.974256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e40aebb49f4c48a8d5c2d330c5de28'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.974913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e40aebb49f4c48a8d5c2d330c5de28'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.981805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-eef1637f-c672-4481-baad-1ab1149b5640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e40aebb49f4c48a8d5c2d330c5de28'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:14.987788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 899/1790] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:14 2022] DELETE /identity/v3/users/a1e40aebb49f4c48a8d5c2d330c5de28 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:14.989061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96c128-e3f6-45fa-a971-62c11db11a32 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:14.989346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96c128-e3f6-45fa-a971-62c11db11a32 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:14.989616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96c128-e3f6-45fa-a971-62c11db11a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.012826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1b96c128-e3f6-45fa-a971-62c11db11a32 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:15.014079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1b96c128-e3f6-45fa-a971-62c11db11a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:15.042421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 892/1791] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:15.048389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cf8a0-c141-4d4c-9928-7d9591f5bca7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.062673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cf8a0-c141-4d4c-9928-7d9591f5bca7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.081894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:15.107854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 900/1792] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:15.109300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9711ae-b495-4e5a-8f5c-9d2fa0918cf6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.109971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9711ae-b495-4e5a-8f5c-9d2fa0918cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.110427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9711ae-b495-4e5a-8f5c-9d2fa0918cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.128851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:15.145853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6c9711ae-b495-4e5a-8f5c-9d2fa0918cf6 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:15.147390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6c9711ae-b495-4e5a-8f5c-9d2fa0918cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:15.162378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 901/1793] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:15.163506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9711ae-b495-4e5a-8f5c-9d2fa0918cf6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.164222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.165013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.165293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.165563 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.166304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:15.166608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.168379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.174420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9711ae-b495-4e5a-8f5c-9d2fa0918cf6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.179900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.180727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.181479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.181479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.181757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 893/1794] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:15.181977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:15.182381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.184861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.185608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.203875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 902/1795] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:15.205072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.206725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1a25b-15b6-4f99-b7b3-d969b63c2328 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.218202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687ce1f-7043-427d-91fb-b291db20ddf6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.223495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.223736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.224299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.224476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.224591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.224744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.224851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.225015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.225659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.225765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.228233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.228929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.279850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 903/1796] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:15.281277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.294072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 894/1797] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:15.298091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.398437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be33ed-738a-4dbd-9365-ba8c2d423039 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.444972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f726b8-36aa-4e59-b058-004318a4d902 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.453008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.454036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.454682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.455170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.456164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.460130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.498936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 895/1798] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:15.518544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.540032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f06cb-f0f0-4ed8-90f1-ab5abca1005d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.547418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.548365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.548966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.549791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.550725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.553744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.572714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 896/1799] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:15.573901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.593317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d85d4-2458-45aa-ba36-e1de229a1f3e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.599753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.600952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.602096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.602766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.603968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.606013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.617213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.619639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.621083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.621372 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.622468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.623336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 897/1800] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:15.627931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.629946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.653032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01b5b-349d-44fe-991e-5e4b1b5d3a05 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.663269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 904/1801] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/users => generated 286 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:15.663805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.665130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.665640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.665874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] PATH_INFO: `/v3/projects/9b77bb3a6a6342bea25c13d3d86cf216/users/4519af595bd8422699ef13242565087a/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.666716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.684879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde7cf8-1271-4b3e-bd8a-4d800c3a58d3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.688567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b77bb3a6a6342bea25c13d3d86cf216, user_id=4519af595bd8422699ef13242565087a, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.691766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.692115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27535e66-deb7-4d27-bedb-01d14e51160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.692944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27535e66-deb7-4d27-bedb-01d14e51160a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.693317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27535e66-deb7-4d27-bedb-01d14e51160a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.694082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27535e66-deb7-4d27-bedb-01d14e51160a admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.694768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27535e66-deb7-4d27-bedb-01d14e51160a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.696909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27535e66-deb7-4d27-bedb-01d14e51160a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.715411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 898/1802] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:15 2022] PUT /identity/v3/projects/9b77bb3a6a6342bea25c13d3d86cf216/users/4519af595bd8422699ef13242565087a/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:15.717024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.723154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 905/1803] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:15.726912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d37f-7d39-4fff-ad26-806c7bb4a317 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.727206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d37f-7d39-4fff-ad26-806c7bb4a317 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.727625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7d37f-7d39-4fff-ad26-806c7bb4a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.799224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-efa7d37f-7d39-4fff-ad26-806c7bb4a317 None None] MFA Rules not processed for user `4519af595bd8422699ef13242565087a`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:15.799433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:15.801919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-efa7d37f-7d39-4fff-ad26-806c7bb4a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:15.841755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a4591-b2b3-42c0-ae4e-af94b62a9595 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.854880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.858887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.859384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:15.860505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.860881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.862120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.869276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.893250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 899/1804] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:15.903875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.927682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd05d3-44f3-4f22-bc21-86b5a79c6e3c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.944727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 906/1805] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:15.946927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d37f-7d39-4fff-ad26-806c7bb4a317 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:15.952388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.953174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.953884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.954225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] PATH_INFO: `/v3/projects/145a60b46c754e24a42d55538157a0c1/users/0beb4291f27646a988c91fe5c95ec252/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.977359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7d37f-7d39-4fff-ad26-806c7bb4a317 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:15.988248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecad445-47db-4aea-a956-2b1460b9c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:15.988790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145a60b46c754e24a42d55538157a0c1, user_id=0beb4291f27646a988c91fe5c95ec252, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:15.990638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecad445-47db-4aea-a956-2b1460b9c8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:15.991018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecad445-47db-4aea-a956-2b1460b9c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:15.991396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecad445-47db-4aea-a956-2b1460b9c8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:15.992053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:15.995980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecad445-47db-4aea-a956-2b1460b9c8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.004056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecad445-47db-4aea-a956-2b1460b9c8ca admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.015881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 900/1806] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:15 2022] PUT /identity/v3/projects/145a60b46c754e24a42d55538157a0c1/users/0beb4291f27646a988c91fe5c95ec252/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:16.017371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.020309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.077648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 907/1807] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:15 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:16.077648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77691abe-461a-4dde-af71-ad11d42dffc0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.077648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77691abe-461a-4dde-af71-ad11d42dffc0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.077648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77691abe-461a-4dde-af71-ad11d42dffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.103851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-77691abe-461a-4dde-af71-ad11d42dffc0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:16.105753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a749-5739-454d-8fdd-6d50dd6f15c9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.107064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-77691abe-461a-4dde-af71-ad11d42dffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.174339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.175060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.175340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.175620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] PATH_INFO: `/v3/projects/21e5484e86084d49b03773b9cdaa7acc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.176816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e5484e86084d49b03773b9cdaa7acc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.179428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.212368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 908/1808] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:16.213317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77691abe-461a-4dde-af71-ad11d42dffc0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.231442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77691abe-461a-4dde-af71-ad11d42dffc0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.237274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.237919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.238230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.238503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.239210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.241183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.248673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e5484e86084d49b03773b9cdaa7acc', 'request_id': 'req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:16.257283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e5484e86084d49b03773b9cdaa7acc', 'request_id': 'req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:16.266464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e5484e86084d49b03773b9cdaa7acc', 'request_id': 'req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:16.267871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.273703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 909/1809] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/users => generated 294 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:16.273703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.273923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.280886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] The token cache is being invalidate because project 21e5484e86084d49b03773b9cdaa7acc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:16.281401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:16.282294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:16.284120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 901/1810] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:16 2022] DELETE /identity/v3/projects/21e5484e86084d49b03773b9cdaa7acc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:16.287535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.288980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.331386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4982c2-8c66-482b-b736-94041f1c7719 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.351501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7803-fec2-4fc8-a5a9-e1b50b3e0ae7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.356169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dd4f6-3d26-4c6e-af09-ff784507264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.356789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd4f6-3d26-4c6e-af09-ff784507264b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.357070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd4f6-3d26-4c6e-af09-ff784507264b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.357342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd4f6-3d26-4c6e-af09-ff784507264b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.358062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dd4f6-3d26-4c6e-af09-ff784507264b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.359703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dd4f6-3d26-4c6e-af09-ff784507264b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.369974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 902/1811] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:16.371822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284ff7-af2c-43f8-a966-0d2f79cde2f1 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.372105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284ff7-af2c-43f8-a966-0d2f79cde2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.372377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284ff7-af2c-43f8-a966-0d2f79cde2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.382710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8452c2e3-e83c-4be9-86f5-47a99e9d22d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.383339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452c2e3-e83c-4be9-86f5-47a99e9d22d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.383615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452c2e3-e83c-4be9-86f5-47a99e9d22d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.383880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452c2e3-e83c-4be9-86f5-47a99e9d22d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.385614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8452c2e3-e83c-4be9-86f5-47a99e9d22d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.392416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f4284ff7-af2c-43f8-a966-0d2f79cde2f1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:16.393878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f4284ff7-af2c-43f8-a966-0d2f79cde2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.395219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.399595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452c2e3-e83c-4be9-86f5-47a99e9d22d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.401159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8452c2e3-e83c-4be9-86f5-47a99e9d22d9 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.409810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 903/1812] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:16.409810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284ff7-af2c-43f8-a966-0d2f79cde2f1 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.411700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 910/1813] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:16.412961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73ca63-e00c-48c5-9d81-1af2b2f18728 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.413985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73ca63-e00c-48c5-9d81-1af2b2f18728 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.414284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73ca63-e00c-48c5-9d81-1af2b2f18728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.422604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284ff7-af2c-43f8-a966-0d2f79cde2f1 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.427944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.429147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.429432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.429740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] PATH_INFO: `/v3/projects/3f4cb8a0737c4142a5365040721f2f2a/users/1a0b214bdf18469cae6e835fd8d28c16/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.435266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3b73ca63-e00c-48c5-9d81-1af2b2f18728 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:16.436485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3b73ca63-e00c-48c5-9d81-1af2b2f18728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.450359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4cb8a0737c4142a5365040721f2f2a, user_id=1a0b214bdf18469cae6e835fd8d28c16, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.453087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.455894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 911/1814] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:16.460102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73ca63-e00c-48c5-9d81-1af2b2f18728 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.469807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 904/1815] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:16 2022] PUT /identity/v3/projects/3f4cb8a0737c4142a5365040721f2f2a/users/1a0b214bdf18469cae6e835fd8d28c16/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:16.473599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.474374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73ca63-e00c-48c5-9d81-1af2b2f18728 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.542602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.543246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.543527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.543804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.544516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:16.544831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.546565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.555201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d858e3-ae4e-4482-b589-41839f9ba594 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.559098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 912/1816] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:16.563450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.573910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46eba7f-7c72-4171-beee-6a134f2d7a49 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.579790 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.580660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.580943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.581219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.581976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.584035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.584270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.585529 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.585816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.586221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.587165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.590237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.609835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 905/1817] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:16.614028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.628658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def97ec2-e193-4742-afe3-d8e27df76cd4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.630198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 913/1818] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/projects => generated 407 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:16.634560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.708023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.720978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43c997-0993-4114-b3fe-e6fd4111cc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.721881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c997-0993-4114-b3fe-e6fd4111cc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.722827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c997-0993-4114-b3fe-e6fd4111cc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.722827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43c997-0993-4114-b3fe-e6fd4111cc77 admin admin] PATH_INFO: `/v3/projects/3f4cb8a0737c4142a5365040721f2f2a/users/1a0b214bdf18469cae6e835fd8d28c16/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.725145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c997-0993-4114-b3fe-e6fd4111cc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4cb8a0737c4142a5365040721f2f2a, user_id=1a0b214bdf18469cae6e835fd8d28c16, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.728035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43c997-0993-4114-b3fe-e6fd4111cc77 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.735982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c05a79-860c-4fd6-9030-33a796b3d5d1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.740969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 906/1819] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:16 2022] PUT /identity/v3/projects/3f4cb8a0737c4142a5365040721f2f2a/users/1a0b214bdf18469cae6e835fd8d28c16/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:16.752589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.753175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.753546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.794374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] MFA Rules not processed for user `1a0b214bdf18469cae6e835fd8d28c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:16.795950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.863925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.864495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.864666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.864943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.865626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.873339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.890922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 907/1820] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:16.904124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:16.904446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.906044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:16.927464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 914/1821] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:16 2022] POST /identity/v3/users => generated 304 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:16.930633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:16.944043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45c9cc-3f7b-4f8c-b1ec-060845825794 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:16.955836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:16.956845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:16.957317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:16.957797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:16.958795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:16.961662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:16.977816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 915/1822] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:16.985151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.005296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b78c2c-ac7e-4e3b-b194-5795e47027c8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.015298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.016106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.016546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.016907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.017687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.021311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.042829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d88d1-062e-4899-9e27-dca4a0172e68 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.049269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 916/1823] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:17.050416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.053523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.054371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.055018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.055491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.059177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.064988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b664b94-7162-4d73-8e41-78f22ab58522 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.072718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498eb5d-8639-4c7c-a574-13b08ae83ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.073753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498eb5d-8639-4c7c-a574-13b08ae83ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.074086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498eb5d-8639-4c7c-a574-13b08ae83ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.074362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498eb5d-8639-4c7c-a574-13b08ae83ad3 admin admin] PATH_INFO: `/v3/projects/a78ad8b0611144369be4558cfd573906/users/eb8113404091405b8a7597dfd5d81589/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.092992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498eb5d-8639-4c7c-a574-13b08ae83ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78ad8b0611144369be4558cfd573906, user_id=eb8113404091405b8a7597dfd5d81589, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.096771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498eb5d-8639-4c7c-a574-13b08ae83ad3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.128667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 917/1824] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:17 2022] PUT /identity/v3/projects/a78ad8b0611144369be4558cfd573906/users/eb8113404091405b8a7597dfd5d81589/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:17.131074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9aa2-cba5-487b-ac7b-e0c2c4de6d2a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.131335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9aa2-cba5-487b-ac7b-e0c2c4de6d2a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.131622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d9aa2-cba5-487b-ac7b-e0c2c4de6d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.137379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.139934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.151988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 908/1825] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:17.187717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f84d9aa2-cba5-487b-ac7b-e0c2c4de6d2a None None] MFA Rules not processed for user `eb8113404091405b8a7597dfd5d81589`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:17.189353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f84d9aa2-cba5-487b-ac7b-e0c2c4de6d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.281509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.287309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.293202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 918/1826] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:17.294609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d9aa2-cba5-487b-ac7b-e0c2c4de6d2a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.330504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73a0b-2fca-4b0a-b9bf-f96b1679e3f6 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.383074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.385704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d9aa2-cba5-487b-ac7b-e0c2c4de6d2a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.391334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.391994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.392398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.392735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.393568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.396195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.440153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.440919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.441204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.441484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] PATH_INFO: `/v3/users/1247b98092164ba4b3253391c3914158` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.442904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1247b98092164ba4b3253391c3914158)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.445219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.447605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 919/1827] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/projects => generated 409 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:17.451929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.507570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.541104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1247b98092164ba4b3253391c3914158'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:17.561681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1247b98092164ba4b3253391c3914158'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:17.562641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12eb50d-6389-412c-b39b-8203dfc2f67e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.562787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1247b98092164ba4b3253391c3914158'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:17.568285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.569980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.569980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.569980 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.570408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.573174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.581408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1247b98092164ba4b3253391c3914158'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:17.595050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0a2f0739-6a30-46d1-a5ac-8c2f4ab1081d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1247b98092164ba4b3253391c3914158'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:17.611457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 909/1828] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:17 2022] DELETE /identity/v3/users/1247b98092164ba4b3253391c3914158 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:17.616899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.617231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.619717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.623977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 920/1829] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:17.628561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.631518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.671052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b826704-068d-4b25-b5c4-63973fe3969d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.672910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:17.674193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.765144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65ff6f-5ff5-4f3b-9282-dd53a7b486e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.765845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 910/1830] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:17.766064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65ff6f-5ff5-4f3b-9282-dd53a7b486e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.766377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65ff6f-5ff5-4f3b-9282-dd53a7b486e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.766822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65ff6f-5ff5-4f3b-9282-dd53a7b486e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.767506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65ff6f-5ff5-4f3b-9282-dd53a7b486e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.769226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65ff6f-5ff5-4f3b-9282-dd53a7b486e7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.773274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.782724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.782812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 921/1831] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:17.785890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.786223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.786506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.815263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] MFA Rules not processed for user `0beb4291f27646a988c91fe5c95ec252`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:17.818086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.838569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:17.843717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4af80-0827-4d6c-b60e-82a333ce44d5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.849154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.849440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.849699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.850503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.863487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.864950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.880481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 911/1832] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:17.882141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.896999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eab708-4e1e-407b-9f23-cd16500f5a3f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.903592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.904346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.904878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.905227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] PATH_INFO: `/v3/projects/40b159fe19f84f1e8e725f009999163c/users/97700ddfeb9048eb95188d6625c477d3/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.908260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 922/1833] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:17.913125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.915048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:17.927608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b159fe19f84f1e8e725f009999163c, user_id=97700ddfeb9048eb95188d6625c477d3, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.930691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cc295-efdb-483c-bc23-30b415856bd9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:17.932739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.936991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:17.937766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:17.938335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:17.938698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:17.939636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:17.942245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:17.953919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 912/1834] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:17 2022] PUT /identity/v3/projects/40b159fe19f84f1e8e725f009999163c/users/97700ddfeb9048eb95188d6625c477d3/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:17.958595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:17.981301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 923/1835] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:17.985388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.010253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.052629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03879b30-e82a-406e-bc36-b314a60e1caf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.099222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6086a1-4305-452b-b6f2-85b49ca0ab4d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.109817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.110758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.111082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.111473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.112284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.114518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.135609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.136927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.137757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.138252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.140437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.142404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.148135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 924/1836] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:17 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:18.149129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.162582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71292d81-9acf-4ecf-abcd-5a3954852f64 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.163774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 913/1837] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:18.168577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.179419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.180363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.180647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.180962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.184140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.185919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.193627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cfc87-f627-4706-8641-bd95b2a85fde admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.206627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d01b3-fc5f-4242-ba50-c9317749628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.207331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d01b3-fc5f-4242-ba50-c9317749628e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.207612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d01b3-fc5f-4242-ba50-c9317749628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.207897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d01b3-fc5f-4242-ba50-c9317749628e admin admin] PATH_INFO: `/v3/projects/40b159fe19f84f1e8e725f009999163c/users/97700ddfeb9048eb95188d6625c477d3/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.216176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d01b3-fc5f-4242-ba50-c9317749628e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b159fe19f84f1e8e725f009999163c, user_id=97700ddfeb9048eb95188d6625c477d3, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.216444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 925/1838] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:18.217828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.224967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d01b3-fc5f-4242-ba50-c9317749628e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.245062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17701c3c-f0de-41c6-aa5d-bd568aaf6c4d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.255373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 914/1839] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:18 2022] PUT /identity/v3/projects/40b159fe19f84f1e8e725f009999163c/users/97700ddfeb9048eb95188d6625c477d3/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:18.272933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4cc73-2f4e-4c81-82fc-4f84a863f20c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.273850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4cc73-2f4e-4c81-82fc-4f84a863f20c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.274471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4cc73-2f4e-4c81-82fc-4f84a863f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.316835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4fd4cc73-2f4e-4c81-82fc-4f84a863f20c None None] MFA Rules not processed for user `97700ddfeb9048eb95188d6625c477d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:18.320608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4fd4cc73-2f4e-4c81-82fc-4f84a863f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:18.365772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.367077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.367077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.367353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] PATH_INFO: `/v3/projects/7b888416672649eb8bab0db4fc9482fc/users/f5b3f9c09d76443da763b590ac966230/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.384014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.390563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b888416672649eb8bab0db4fc9482fc, user_id=f5b3f9c09d76443da763b590ac966230, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.394816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.420560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 926/1840] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:18 2022] PUT /identity/v3/projects/7b888416672649eb8bab0db4fc9482fc/users/f5b3f9c09d76443da763b590ac966230/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:18.421815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.423835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:18.431971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 915/1841] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:18.432944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4cc73-2f4e-4c81-82fc-4f84a863f20c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.467101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4cc73-2f4e-4c81-82fc-4f84a863f20c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.583561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.584207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.585851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb404ce-0eb2-43e0-b536-e7c57d8e720d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.586919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.587307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.588559 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.592795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.597856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.599190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.600503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.602005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] PATH_INFO: `/v3/projects/b72d3b14865842b5af5196261ba4f10c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.605233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72d3b14865842b5af5196261ba4f10c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:18.609063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:18.622971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 916/1842] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:18.624651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.630382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:18.667058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:18.769731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72d3b14865842b5af5196261ba4f10c', 'request_id': 'req-e2f6e981-ca91-4306-ab69-65b20e7661ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:18.800494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72d3b14865842b5af5196261ba4f10c', 'request_id': 'req-e2f6e981-ca91-4306-ab69-65b20e7661ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:18.810120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72d3b14865842b5af5196261ba4f10c', 'request_id': 'req-e2f6e981-ca91-4306-ab69-65b20e7661ae'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:18.832759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0486705-d3b3-4279-8275-18c7c7bc5482 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:18.835830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] The token cache is being invalidate because project b72d3b14865842b5af5196261ba4f10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:18.836404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:18.842429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e2f6e981-ca91-4306-ab69-65b20e7661ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:18.844984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 927/1843] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:18 2022] DELETE /identity/v3/projects/b72d3b14865842b5af5196261ba4f10c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:18.857753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d87a1b-0e1b-4b8c-a343-9d1bcc0607fc None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.858066 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d87a1b-0e1b-4b8c-a343-9d1bcc0607fc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.858344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d87a1b-0e1b-4b8c-a343-9d1bcc0607fc None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.859877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 928/1844] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:21:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:21:18.860412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d87a1b-0e1b-4b8c-a343-9d1bcc0607fc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:18.866925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-52d87a1b-0e1b-4b8c-a343-9d1bcc0607fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:18.971970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edf33e-6cad-4b84-8a63-6d131770ae50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:18.973247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf33e-6cad-4b84-8a63-6d131770ae50 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:18.973539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf33e-6cad-4b84-8a63-6d131770ae50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:18.973816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edf33e-6cad-4b84-8a63-6d131770ae50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:18.982154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-03edf33e-6cad-4b84-8a63-6d131770ae50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:19.049824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d87a1b-0e1b-4b8c-a343-9d1bcc0607fc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:19.061635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:19.063249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.063249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.063427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] PATH_INFO: `/v3/projects/7b888416672649eb8bab0db4fc9482fc/users/f5b3f9c09d76443da763b590ac966230/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:19.069546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b888416672649eb8bab0db4fc9482fc, user_id=f5b3f9c09d76443da763b590ac966230, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:19.082209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:19.104589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 929/1845] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:18 2022] PUT /identity/v3/projects/7b888416672649eb8bab0db4fc9482fc/users/f5b3f9c09d76443da763b590ac966230/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:19.111139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:19.112951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:19.115045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:19.170121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edf33e-6cad-4b84-8a63-6d131770ae50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:19.176160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edf33e-6cad-4b84-8a63-6d131770ae50 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:19.197597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 917/1846] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:18 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:19.200111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.201176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.201695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:19.235865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:19.237224 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:19.271434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98599dc1-b6e1-4692-b170-413471127480 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:19.283702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:19.284352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.286514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.288179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] PATH_INFO: `/v3/users/74df30790dc148dea2af4de7bd849a99` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:19.290482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74df30790dc148dea2af4de7bd849a99)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:19.298694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:19.371365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 918/1847] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:21:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:19.431405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:19.433809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74df30790dc148dea2af4de7bd849a99'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:19.456652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74df30790dc148dea2af4de7bd849a99'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:19.474863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74df30790dc148dea2af4de7bd849a99'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:19.475727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74df30790dc148dea2af4de7bd849a99'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:19.483741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74df30790dc148dea2af4de7bd849a99'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:19.490432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 930/1848] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:19 2022] DELETE /identity/v3/users/74df30790dc148dea2af4de7bd849a99 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:19.518681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:19.520517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:19.607705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84398825-a5fc-42a0-9129-c46ba838acf8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:19.668046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:19.668925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.669184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.669526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:19.671692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:19.731190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:19.745882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:19.747713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:19.770304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 919/1849] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:19.832230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:19.833673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:19.933735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:19.933735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:19.972652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015c943-7eb3-4c3d-877f-31ef2c5f5a46 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:19.977563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:19.978991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:19.980509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:19.981750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] PATH_INFO: `/v3/projects/82920501e45b44cc90f7f55dead68814` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:19.985280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82920501e45b44cc90f7f55dead68814)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:19.992203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.075142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20592b-f2ab-49d8-90ad-3fd7d5d4a3ac service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.086544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770437c2-058a-4c75-bde3-0728f51bb760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.087378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770437c2-058a-4c75-bde3-0728f51bb760 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.087709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770437c2-058a-4c75-bde3-0728f51bb760 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.087987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770437c2-058a-4c75-bde3-0728f51bb760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.091007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-770437c2-058a-4c75-bde3-0728f51bb760 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:20.116224 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770437c2-058a-4c75-bde3-0728f51bb760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.120009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770437c2-058a-4c75-bde3-0728f51bb760 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.123634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82920501e45b44cc90f7f55dead68814', 'request_id': 'req-6ffc714d-4615-47c1-b24b-91c5c26d12a0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:20.139098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 920/1850] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:20.143781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82920501e45b44cc90f7f55dead68814', 'request_id': 'req-6ffc714d-4615-47c1-b24b-91c5c26d12a0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:20.156034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82920501e45b44cc90f7f55dead68814', 'request_id': 'req-6ffc714d-4615-47c1-b24b-91c5c26d12a0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:20.203349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] The token cache is being invalidate because project 82920501e45b44cc90f7f55dead68814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:20.205164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:20.207635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:20.210711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 931/1851] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:19 2022] DELETE /identity/v3/projects/82920501e45b44cc90f7f55dead68814 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:20.216610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83d62-3b61-4f80-a96c-93b81b073196 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.225058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83d62-3b61-4f80-a96c-93b81b073196 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.230423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83d62-3b61-4f80-a96c-93b81b073196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.254327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.255917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:20.292026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6bd83d62-3b61-4f80-a96c-93b81b073196 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:20.295014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6bd83d62-3b61-4f80-a96c-93b81b073196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:20.392978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc714d-4615-47c1-b24b-91c5c26d12a0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.401287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.403467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.404134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.406013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.410403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:20.419183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:20.461672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 921/1852] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:20.467788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597e19-90b1-4ec3-a4e9-71fedfc1a8e9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.468074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597e19-90b1-4ec3-a4e9-71fedfc1a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.468351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f597e19-90b1-4ec3-a4e9-71fedfc1a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.512964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4f597e19-90b1-4ec3-a4e9-71fedfc1a8e9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:20.514233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4f597e19-90b1-4ec3-a4e9-71fedfc1a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:20.536009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 922/1853] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:20.538423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597e19-90b1-4ec3-a4e9-71fedfc1a8e9 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.563811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f597e19-90b1-4ec3-a4e9-71fedfc1a8e9 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.570380 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.571417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.579555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.580408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.580688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.580964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.581750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:20.582099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.585082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.597810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 932/1854] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:20.606333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 923/1855] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:20.608061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.629550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50298-1223-4ec0-bf73-f8fe89ba2b5c service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.645987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.646647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.646929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.647262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.647951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.650138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.705953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 933/1856] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:20 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:20.707117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.721855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfa8b5-bca5-4b94-a4e0-abe58dbc7340 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.855736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:20.867464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.868876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.869176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.869455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.870574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.872796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.916982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 924/1857] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:20 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:20.921341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.932811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245c9c8-a922-4981-a6d2-eba938569d7a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:20.939109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:20.939835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:20.940182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:20.940527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:20.941305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:20.943225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:20.956534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 934/1858] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:20.961571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:20.986116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb44ea-427e-4698-978d-8ddd37825881 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.050632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a0562-f1aa-443b-93e0-1a213a985d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.051302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0562-f1aa-443b-93e0-1a213a985d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.055096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0562-f1aa-443b-93e0-1a213a985d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.056180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a0562-f1aa-443b-93e0-1a213a985d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.059400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a0562-f1aa-443b-93e0-1a213a985d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.063179 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a0562-f1aa-443b-93e0-1a213a985d7d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.080129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 925/1859] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:21.084752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.100334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e1f3b-d602-42e7-bd50-48b2b4e19f06 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.115851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efd1d9-a7ad-4425-8b32-d86cd741c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.116797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd1d9-a7ad-4425-8b32-d86cd741c4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.117630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd1d9-a7ad-4425-8b32-d86cd741c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.118114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efd1d9-a7ad-4425-8b32-d86cd741c4f0 admin admin] PATH_INFO: `/v3/projects/ef91799437674855a7a2004e95785f26/users/0dcf9f6b13454b349a87ca555db6e761/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.144070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efd1d9-a7ad-4425-8b32-d86cd741c4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef91799437674855a7a2004e95785f26, user_id=0dcf9f6b13454b349a87ca555db6e761, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.146906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efd1d9-a7ad-4425-8b32-d86cd741c4f0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.166185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 935/1860] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:21 2022] PUT /identity/v3/projects/ef91799437674855a7a2004e95785f26/users/0dcf9f6b13454b349a87ca555db6e761/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:21.177789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d8356-81d3-4dfe-9c98-65aa0c80b5fd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.179395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d8356-81d3-4dfe-9c98-65aa0c80b5fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.179395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d8356-81d3-4dfe-9c98-65aa0c80b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.226031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-138d8356-81d3-4dfe-9c98-65aa0c80b5fd None None] MFA Rules not processed for user `0dcf9f6b13454b349a87ca555db6e761`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:21.227991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-138d8356-81d3-4dfe-9c98-65aa0c80b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:21.277904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19dd0-d106-4f32-8b17-1532fd1cef67 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.278235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19dd0-d106-4f32-8b17-1532fd1cef67 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.278487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e19dd0-d106-4f32-8b17-1532fd1cef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.318679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-90e19dd0-d106-4f32-8b17-1532fd1cef67 None None] MFA Rules not processed for user `f5b3f9c09d76443da763b590ac966230`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:21.320847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-90e19dd0-d106-4f32-8b17-1532fd1cef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:21.353599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 926/1861] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:21.358570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d8356-81d3-4dfe-9c98-65aa0c80b5fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.430761 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 936/1862] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:21.441680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.441680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.441680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.477642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] MFA Rules not processed for user `0beb4291f27646a988c91fe5c95ec252`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:21.480018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:21.483258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d8356-81d3-4dfe-9c98-65aa0c80b5fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.490049 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.491046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.491502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.492121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.492961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.496193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.535107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:21.540891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 927/1863] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:21 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:21.545945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.578585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 937/1864] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:21.593710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.595959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:21.611342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:21.645253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9e712-68af-423d-bbec-658473913412 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.656997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.657643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.657954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.658218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.658897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.660863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.693662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 928/1865] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:21 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:21.699839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.713424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8eaffa-462e-47b2-9a0d-a02fb6b7657d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.718185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3361069-61ee-4785-bfee-725b8dfd6e88 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.718879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.719492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.719770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.720042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.720748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.722440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.735655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 929/1866] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:21.740046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.755597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eda19a-cc8c-476e-b15a-2d0b8153c428 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.765080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.765870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.766297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.766667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] PATH_INFO: `/v3/projects/b74d797612c54a65a4aa1afc7494e62d/users/071b218ed023406fa2db5899cd6ed9b0/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.784990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74d797612c54a65a4aa1afc7494e62d, user_id=071b218ed023406fa2db5899cd6ed9b0, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.788284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.809319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a3835-2b87-4011-9bf1-93778c0750ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.810460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3835-2b87-4011-9bf1-93778c0750ed service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.810935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3835-2b87-4011-9bf1-93778c0750ed service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.811297 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a3835-2b87-4011-9bf1-93778c0750ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.813012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 930/1867] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:21 2022] PUT /identity/v3/projects/b74d797612c54a65a4aa1afc7494e62d/users/071b218ed023406fa2db5899cd6ed9b0/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:21.816180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-074a3835-2b87-4011-9bf1-93778c0750ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:21.816799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.893360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10232b96-32c2-4f5d-88c3-94ece6293922 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.895786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a3835-2b87-4011-9bf1-93778c0750ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.898609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a3835-2b87-4011-9bf1-93778c0750ed service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.898901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.899675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.900055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.900417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.902251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.904107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.921229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 931/1868] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:21.922157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:21.923442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 938/1869] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:21.935353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bda62f-e8a2-48a2-9f77-da19f46099d9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:21.943823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:21.944556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.944826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.945113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] PATH_INFO: `/v3/projects/b74d797612c54a65a4aa1afc7494e62d/users/071b218ed023406fa2db5899cd6ed9b0/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:21.947830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74d797612c54a65a4aa1afc7494e62d, user_id=071b218ed023406fa2db5899cd6ed9b0, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:21.951265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:21.970056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 932/1870] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:21 2022] PUT /identity/v3/projects/b74d797612c54a65a4aa1afc7494e62d/users/071b218ed023406fa2db5899cd6ed9b0/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:21.979301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268efc2-2389-476c-a867-0dc48ec7df60 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:21.980068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268efc2-2389-476c-a867-0dc48ec7df60 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:21.981131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268efc2-2389-476c-a867-0dc48ec7df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.012513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:22.023293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c268efc2-2389-476c-a867-0dc48ec7df60 None None] MFA Rules not processed for user `071b218ed023406fa2db5899cd6ed9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:22.024283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c268efc2-2389-476c-a867-0dc48ec7df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:22.106672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 939/1871] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:22.118692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:22.120584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:22.185731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9916e89-56e6-45b3-a714-37b51834e737 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:22.190166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:22.190809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:22.191095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:22.191367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.202601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:22.204089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:22.216172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 933/1872] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:22.306098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268efc2-2389-476c-a867-0dc48ec7df60 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:22.319340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268efc2-2389-476c-a867-0dc48ec7df60 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:22.326402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe797c5-92a5-4b01-adf5-13690b3010e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:22.327059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe797c5-92a5-4b01-adf5-13690b3010e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:22.327404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe797c5-92a5-4b01-adf5-13690b3010e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:22.327734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe797c5-92a5-4b01-adf5-13690b3010e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:22.408000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe797c5-92a5-4b01-adf5-13690b3010e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:22.410771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe797c5-92a5-4b01-adf5-13690b3010e4 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:22.428383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 940/1873] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:25.838750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:25.840203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:25.874572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:25.923593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3643fdd-cd0a-4347-9276-4187356ee94f service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:25.929965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:25.931527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:25.931527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:25.931527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] PATH_INFO: `/v3/users/eb8113404091405b8a7597dfd5d81589` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:25.932611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8113404091405b8a7597dfd5d81589)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:25.934665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.007390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8113404091405b8a7597dfd5d81589'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.029389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8113404091405b8a7597dfd5d81589'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.038478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8113404091405b8a7597dfd5d81589'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.056290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8113404091405b8a7597dfd5d81589'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.073880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8113404091405b8a7597dfd5d81589'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.091163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 934/1874] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:25 2022] DELETE /identity/v3/users/eb8113404091405b8a7597dfd5d81589 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:26.096439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.097070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.097070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.138638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:26.146727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:26.233458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 941/1875] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:26.244324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.246182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:26.337046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f13623-2d13-4d8e-bdf9-bffd661090e7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.345194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d9964-e74b-4834-83c6-6bf52af22783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.346101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d9964-e74b-4834-83c6-6bf52af22783 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.346651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d9964-e74b-4834-83c6-6bf52af22783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.346974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d9964-e74b-4834-83c6-6bf52af22783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.362823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d9964-e74b-4834-83c6-6bf52af22783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.368035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d9964-e74b-4834-83c6-6bf52af22783 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.386260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 935/1876] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:26.450139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.452153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:26.466988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ed9b9-8f46-4e04-a7b9-e4fff1f339e8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.473582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.474307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.475007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.475362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] PATH_INFO: `/v3/users/0dcf9f6b13454b349a87ca555db6e761` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.477584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcf9f6b13454b349a87ca555db6e761)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.480420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.564764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:26.591978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcf9f6b13454b349a87ca555db6e761'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.607873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcf9f6b13454b349a87ca555db6e761'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.629976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcf9f6b13454b349a87ca555db6e761'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.631052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcf9f6b13454b349a87ca555db6e761'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.643946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcf9f6b13454b349a87ca555db6e761'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.655435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 942/1877] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:26 2022] DELETE /identity/v3/users/0dcf9f6b13454b349a87ca555db6e761 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:26.657688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.657872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.658171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.687882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:26.689126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:26.745684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:26.769134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 936/1878] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:26.780791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.782373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:26.814317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.815760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:26.830360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf2a66-f15d-4125-ac64-e8912a8006f8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.836779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.837984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.838388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.838904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] PATH_INFO: `/v3/projects/a78ad8b0611144369be4558cfd573906` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.840639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78ad8b0611144369be4558cfd573906)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.844119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.888397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b9f16-665a-4b3a-9d8e-f6784c0c164b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:26.892615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:26.893262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:26.893538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:26.893811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:26.908594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:26.909718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78ad8b0611144369be4558cfd573906', 'request_id': 'req-de426a17-23cf-448c-ae75-b06eaa16a1bc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.910241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:26.922637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 943/1879] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:26.922974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78ad8b0611144369be4558cfd573906', 'request_id': 'req-de426a17-23cf-448c-ae75-b06eaa16a1bc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.942149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78ad8b0611144369be4558cfd573906', 'request_id': 'req-de426a17-23cf-448c-ae75-b06eaa16a1bc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.962751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] The token cache is being invalidate because project a78ad8b0611144369be4558cfd573906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:26.963037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.963787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:26.965964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 937/1880] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:26 2022] DELETE /identity/v3/projects/a78ad8b0611144369be4558cfd573906 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:26.970037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:26.982803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b85d0c-1051-4d12-9c98-59a88fd9ddcd service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:27.068384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:27.069189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:27.069892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:27.069892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] PATH_INFO: `/v3/users/97700ddfeb9048eb95188d6625c477d3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:27.072092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97700ddfeb9048eb95188d6625c477d3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:27.074315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:27.144566 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97700ddfeb9048eb95188d6625c477d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.150723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:27.158263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97700ddfeb9048eb95188d6625c477d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.176140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97700ddfeb9048eb95188d6625c477d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.176901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97700ddfeb9048eb95188d6625c477d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.184547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97700ddfeb9048eb95188d6625c477d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.191708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 944/1881] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:26 2022] DELETE /identity/v3/users/97700ddfeb9048eb95188d6625c477d3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:27.364874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:27.366537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:27.388150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426a17-23cf-448c-ae75-b06eaa16a1bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:27.528502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:27.530368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:27.532169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:27.532516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] PATH_INFO: `/v3/projects/ef91799437674855a7a2004e95785f26` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:27.537008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef91799437674855a7a2004e95785f26)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:27.541571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:27.632868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef91799437674855a7a2004e95785f26', 'request_id': 'req-9cc1443e-fe89-4249-95fc-7aa3effed9f5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.633843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:27.635901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:27.642694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef91799437674855a7a2004e95785f26', 'request_id': 'req-9cc1443e-fe89-4249-95fc-7aa3effed9f5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.652400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef91799437674855a7a2004e95785f26', 'request_id': 'req-9cc1443e-fe89-4249-95fc-7aa3effed9f5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.666887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] The token cache is being invalidate because project ef91799437674855a7a2004e95785f26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:27.667335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.668154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.670238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 938/1882] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:27 2022] DELETE /identity/v3/projects/ef91799437674855a7a2004e95785f26 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:27.674349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:27.675741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:27.678999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f138aa3-4f87-44f8-80f8-70dbbd53e864 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:27.680611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:27.773590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:27.774356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:27.774640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:27.774967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] PATH_INFO: `/v3/projects/40b159fe19f84f1e8e725f009999163c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:27.776275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b159fe19f84f1e8e725f009999163c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:27.778263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1443e-fe89-4249-95fc-7aa3effed9f5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:27.778399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:27.784781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:27.785393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:27.785783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:27.786446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] PATH_INFO: `/v3/users/071b218ed023406fa2db5899cd6ed9b0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:27.787794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] RBAC: Authorizing `identity:delete_user(user_id=071b218ed023406fa2db5899cd6ed9b0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:27.792812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:27.855158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b159fe19f84f1e8e725f009999163c', 'request_id': 'req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.864945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071b218ed023406fa2db5899cd6ed9b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.866670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b159fe19f84f1e8e725f009999163c', 'request_id': 'req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.876120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b159fe19f84f1e8e725f009999163c', 'request_id': 'req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.899607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] The token cache is being invalidate because project 40b159fe19f84f1e8e725f009999163c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:27.900307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.901676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-97679c6a-6bcb-40b2-b52e-66a90e5f7d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.905341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 945/1883] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:27 2022] DELETE /identity/v3/projects/40b159fe19f84f1e8e725f009999163c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:27.906613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071b218ed023406fa2db5899cd6ed9b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.909026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071b218ed023406fa2db5899cd6ed9b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.911609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617a7b-e310-4885-b01b-44db2cc2dbc2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:27.912046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617a7b-e310-4885-b01b-44db2cc2dbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:27.912419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87617a7b-e310-4885-b01b-44db2cc2dbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:27.934822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071b218ed023406fa2db5899cd6ed9b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.944584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-87617a7b-e310-4885-b01b-44db2cc2dbc2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:27.946028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-87617a7b-e310-4885-b01b-44db2cc2dbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:27.948297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ffcbb744-f22f-4ff5-8697-ab6270bc129b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071b218ed023406fa2db5899cd6ed9b0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:27.956114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 939/1884] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:27 2022] DELETE /identity/v3/users/071b218ed023406fa2db5899cd6ed9b0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:28.006702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.030166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428f70-218c-4aec-a90a-2665592802a5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.030374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428f70-218c-4aec-a90a-2665592802a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.031038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428f70-218c-4aec-a90a-2665592802a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.034574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 946/1885] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:28.075786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fd428f70-218c-4aec-a90a-2665592802a5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:28.077273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fd428f70-218c-4aec-a90a-2665592802a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.176954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 940/1886] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:28.181458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617a7b-e310-4885-b01b-44db2cc2dbc2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.191762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87617a7b-e310-4885-b01b-44db2cc2dbc2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.196716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.197436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.197781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.198154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.198953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:28.199324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.201285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.214626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 947/1887] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:28.218903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428f70-218c-4aec-a90a-2665592802a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.228748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428f70-218c-4aec-a90a-2665592802a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.234237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.235025 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.235404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.235799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.236576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.238740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.265173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.278882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 941/1888] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:28.281356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.294284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c671f-5fd8-4c0a-a281-394da4d67d18 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.307585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.311486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.388067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.388811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.389091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.389442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.390214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.392367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.393916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5cd41-5402-42e4-a1cb-94a0d9c467cf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.398888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.399999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.399999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.400197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] PATH_INFO: `/v3/projects/b74d797612c54a65a4aa1afc7494e62d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.401835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74d797612c54a65a4aa1afc7494e62d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.403206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.422677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 948/1889] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:28.427978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.442346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc8709-5b7a-444b-8dba-fd8f2a6e3b81 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.448081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.448730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.449018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.449277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.450011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.451773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.466812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 949/1890] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:28.470868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.477332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74d797612c54a65a4aa1afc7494e62d', 'request_id': 'req-3d13bda9-7d0e-4c44-a886-270b323a15c2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:28.483035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec95b1f-cf44-4050-b222-71f6ad874e84 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.507734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74d797612c54a65a4aa1afc7494e62d', 'request_id': 'req-3d13bda9-7d0e-4c44-a886-270b323a15c2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:28.517117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74d797612c54a65a4aa1afc7494e62d', 'request_id': 'req-3d13bda9-7d0e-4c44-a886-270b323a15c2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:28.543724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] The token cache is being invalidate because project b74d797612c54a65a4aa1afc7494e62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:28.544124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:28.545210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3d13bda9-7d0e-4c44-a886-270b323a15c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:28.550091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 942/1891] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:28 2022] DELETE /identity/v3/projects/b74d797612c54a65a4aa1afc7494e62d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:28.554623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6396c-02bb-40e4-adb8-a010a0735ccf None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.555380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6396c-02bb-40e4-adb8-a010a0735ccf None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.555673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6396c-02bb-40e4-adb8-a010a0735ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.576172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.577124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.577406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.577679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.579338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.581145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.594816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5eb6396c-02bb-40e4-adb8-a010a0735ccf None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:28.594992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 950/1892] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:28.596399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5eb6396c-02bb-40e4-adb8-a010a0735ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.598821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.601550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.607831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 943/1893] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:28.615972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78903180-f727-42cb-acc5-ae507fab8738 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.616459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78903180-f727-42cb-acc5-ae507fab8738 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.616921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78903180-f727-42cb-acc5-ae507fab8738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.637209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7c175-cfc6-46bd-b83e-fabbf8f63c96 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.642585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf3b85-8b38-4829-928a-33307522f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.643523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3b85-8b38-4829-928a-33307522f142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.644013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3b85-8b38-4829-928a-33307522f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.644487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf3b85-8b38-4829-928a-33307522f142 admin admin] PATH_INFO: `/v3/projects/1921d7f183c54cb3801d9c10a0594be9/users/b79ae3845ef74b25a69995bbd495ce82/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.667944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-78903180-f727-42cb-acc5-ae507fab8738 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:28.668681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf3b85-8b38-4829-928a-33307522f142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1921d7f183c54cb3801d9c10a0594be9, user_id=b79ae3845ef74b25a69995bbd495ce82, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.671164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-78903180-f727-42cb-acc5-ae507fab8738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.672478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf3b85-8b38-4829-928a-33307522f142 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.686826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 944/1894] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:28.691354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78903180-f727-42cb-acc5-ae507fab8738 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.701174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 951/1895] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:28 2022] PUT /identity/v3/projects/1921d7f183c54cb3801d9c10a0594be9/users/b79ae3845ef74b25a69995bbd495ce82/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:28.706077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78903180-f727-42cb-acc5-ae507fab8738 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.714200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367912-ed49-42c1-82f3-69e7c754c650 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.715098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367912-ed49-42c1-82f3-69e7c754c650 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.715098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e367912-ed49-42c1-82f3-69e7c754c650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.766348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0e367912-ed49-42c1-82f3-69e7c754c650 None None] MFA Rules not processed for user `b79ae3845ef74b25a69995bbd495ce82`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:28.767819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0e367912-ed49-42c1-82f3-69e7c754c650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:28.798808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.799714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.800066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.801193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.801193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:28.801543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.803404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.809059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.825806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 945/1896] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:28.829787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.844874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd9c56-4aa8-4621-9bec-52c8025fd3e3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.853028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.853961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.854959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.855340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.856119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.858356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.866965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 952/1897] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:28.871433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e367912-ed49-42c1-82f3-69e7c754c650 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.873359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:28.891907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e367912-ed49-42c1-82f3-69e7c754c650 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:28.898886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:28.899819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 946/1898] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/projects => generated 401 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:28.900476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:28.900975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:28.901254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:28.901965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:28.903728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:28.904236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:28.995868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 953/1899] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:28.998691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.018579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ae841-81a5-4427-88d1-54d92a1a7def admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.107863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d06c22-a500-4094-945f-84736615edb1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.115600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.116282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.116617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.117016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.117629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.119606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.123317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.124230 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.124723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.125201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.126098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.131465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.157145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 954/1900] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:29.158826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.180492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338379fe-13f1-456d-9a40-40b9fef646bb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.186496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 947/1901] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:28 2022] POST /identity/v3/users => generated 301 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:29.189631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.191864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.193260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.194244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.196163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.197059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.200241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.215889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca1419-6409-4db5-adc6-fc15129614d6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.225667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 955/1902] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:29.227855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.234004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.234654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.234939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.235697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.236414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.241403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.255083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1274c-0eeb-4f62-bd3b-cefcc95f79dd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.261272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.262053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.262329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.262646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] PATH_INFO: `/v3/projects/4ba1738f7e4546b1b90826caf95192d1/users/47317b84ff3848518a1f9e3642ac7bad/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.273998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 948/1903] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:29.279802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.305357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ab79d-9feb-4507-8936-318bc74c4a96 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.311593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba1738f7e4546b1b90826caf95192d1, user_id=47317b84ff3848518a1f9e3642ac7bad, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.314792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.316352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.316643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.316942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.317489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.317792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.321650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.351033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 956/1904] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:29 2022] PUT /identity/v3/projects/4ba1738f7e4546b1b90826caf95192d1/users/47317b84ff3848518a1f9e3642ac7bad/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:29.355182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 949/1905] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:29.356315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.356486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.385775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5f899-eada-4e4c-9eb1-5f5d7052ec8f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.450143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832d57-5af3-4f0c-bd63-c5146894057b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.455863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.456516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.456800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.457162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.457896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.459937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.462001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.477043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e605a23-2859-4597-950c-c21390480052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.477752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605a23-2859-4597-950c-c21390480052 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.478350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605a23-2859-4597-950c-c21390480052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.478628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605a23-2859-4597-950c-c21390480052 admin admin] PATH_INFO: `/v3/projects/9cd996196b14457c9bca5cec413aa846/users/4ff3d5d93d8e4922bac10516e183a85b/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.487822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 957/1906] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:29.492713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.499542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:29.502938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605a23-2859-4597-950c-c21390480052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd996196b14457c9bca5cec413aa846, user_id=4ff3d5d93d8e4922bac10516e183a85b, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.506636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e82644-7d42-48c7-ae7f-28b2d127c606 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.508949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605a23-2859-4597-950c-c21390480052 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.512699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55060c01-1378-4543-befd-9d9220fd8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.513452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55060c01-1378-4543-befd-9d9220fd8b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.514282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55060c01-1378-4543-befd-9d9220fd8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.514645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55060c01-1378-4543-befd-9d9220fd8b2a admin admin] PATH_INFO: `/v3/projects/4ba1738f7e4546b1b90826caf95192d1/users/47317b84ff3848518a1f9e3642ac7bad/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.517793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55060c01-1378-4543-befd-9d9220fd8b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba1738f7e4546b1b90826caf95192d1, user_id=47317b84ff3848518a1f9e3642ac7bad, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.521124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55060c01-1378-4543-befd-9d9220fd8b2a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.532705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 950/1907] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:29 2022] PUT /identity/v3/projects/9cd996196b14457c9bca5cec413aa846/users/4ff3d5d93d8e4922bac10516e183a85b/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:29.536729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 958/1908] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:29 2022] PUT /identity/v3/projects/4ba1738f7e4546b1b90826caf95192d1/users/47317b84ff3848518a1f9e3642ac7bad/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:29.544058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435cbd-695f-408a-812c-a8f74a688150 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.544552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435cbd-695f-408a-812c-a8f74a688150 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.544831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74435cbd-695f-408a-812c-a8f74a688150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.547161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.547756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.548395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.593426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-74435cbd-695f-408a-812c-a8f74a688150 None None] MFA Rules not processed for user `4ff3d5d93d8e4922bac10516e183a85b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:29.596722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-74435cbd-695f-408a-812c-a8f74a688150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:29.606031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] MFA Rules not processed for user `47317b84ff3848518a1f9e3642ac7bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:29.607855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:29.719097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 951/1909] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:29.727051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74435cbd-695f-408a-812c-a8f74a688150 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.730353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 959/1910] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:29.755462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.762148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:29.820043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74435cbd-695f-408a-812c-a8f74a688150 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.826206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.827032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.827468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.827887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.828728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.831354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:29.875190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 952/1911] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:29 2022] POST /identity/v3/projects => generated 401 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:29.876222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:29.897136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08211788-8aff-41af-8362-2b19e7af4dff None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.964198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38dec15-87b6-47b7-8182-1a1632e59ead admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:29.967661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.968311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.968617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.968900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.977468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:29.977468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:29.977468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:29.977799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:29.978338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:29.984121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.004878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:30.029269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 953/1912] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:29 2022] POST /identity/v3/users => generated 307 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:30.030321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.044481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:30.051324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedec4d-f2fa-4811-9aec-0a988eeb77f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.061233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.061968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.062247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.063831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.065304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.069637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.083319 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.085712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.093359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 954/1913] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:30.097188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.108972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 960/1914] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:30.116560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb2c5f3-3687-4251-ba7f-fabc33f4f03d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.126511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.127218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.127501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.127776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] PATH_INFO: `/v3/projects/c709aa0cf3f74179add0369e4db28d00/users/55268d62ef154c6a9145857f12dc9a05/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.157886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c709aa0cf3f74179add0369e4db28d00, user_id=55268d62ef154c6a9145857f12dc9a05, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.162032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.184920 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 955/1915] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:30 2022] PUT /identity/v3/projects/c709aa0cf3f74179add0369e4db28d00/users/55268d62ef154c6a9145857f12dc9a05/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:30.189182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.204213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1bd97-83f1-435f-ad55-7aa526fd2797 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.297748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bce080-481d-436f-9711-53b2ac47782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.298437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce080-481d-436f-9711-53b2ac47782e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.298776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce080-481d-436f-9711-53b2ac47782e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.298985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bce080-481d-436f-9711-53b2ac47782e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.299700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bce080-481d-436f-9711-53b2ac47782e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.301398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bce080-481d-436f-9711-53b2ac47782e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.316696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 961/1916] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:30.320590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.333030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d80fc-ef69-48df-ba90-cbf61c927d73 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.340390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.341358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.342166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.342694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] PATH_INFO: `/v3/projects/c709aa0cf3f74179add0369e4db28d00/users/55268d62ef154c6a9145857f12dc9a05/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.345804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c709aa0cf3f74179add0369e4db28d00, user_id=55268d62ef154c6a9145857f12dc9a05, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.363673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.395801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 956/1917] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:30 2022] PUT /identity/v3/projects/c709aa0cf3f74179add0369e4db28d00/users/55268d62ef154c6a9145857f12dc9a05/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:30.407818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3cf9-8a03-4b50-8cc5-f06fc1e0cbc0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.407818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3cf9-8a03-4b50-8cc5-f06fc1e0cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.407818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d3cf9-8a03-4b50-8cc5-f06fc1e0cbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.446361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0c4d3cf9-8a03-4b50-8cc5-f06fc1e0cbc0 None None] MFA Rules not processed for user `55268d62ef154c6a9145857f12dc9a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:30.447863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0c4d3cf9-8a03-4b50-8cc5-f06fc1e0cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:30.559082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 962/1918] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:30 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:30.581359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.666010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea283ce5-308d-4a5c-9221-22a33443dd96 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.672087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.672802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.673955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.673955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.688235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.690120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.708432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 957/1919] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:30.807047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d3cf9-8a03-4b50-8cc5-f06fc1e0cbc0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:30.819175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d3cf9-8a03-4b50-8cc5-f06fc1e0cbc0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:30.823140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4e6a2-78be-4140-a9ae-5355ecb0fd6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:30.823891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e6a2-78be-4140-a9ae-5355ecb0fd6a service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:30.824234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e6a2-78be-4140-a9ae-5355ecb0fd6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:30.824569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4e6a2-78be-4140-a9ae-5355ecb0fd6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:30.917538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:30.936141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e6a2-78be-4140-a9ae-5355ecb0fd6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:30.940985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4e6a2-78be-4140-a9ae-5355ecb0fd6a service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:30.981097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 963/1920] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:30 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:31.490581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:31.561426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3ad59-41c0-4a2c-bc80-191c83090ee2 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:31.569162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:31.570092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.570455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.570807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] PATH_INFO: `/v3/users/b79ae3845ef74b25a69995bbd495ce82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.574821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b79ae3845ef74b25a69995bbd495ce82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:31.578710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:31.641303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b79ae3845ef74b25a69995bbd495ce82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:31.643174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:31.651892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b79ae3845ef74b25a69995bbd495ce82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:31.655304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b79ae3845ef74b25a69995bbd495ce82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:31.670259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b79ae3845ef74b25a69995bbd495ce82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:31.683943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b79ae3845ef74b25a69995bbd495ce82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:31.694921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 958/1921] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:31 2022] DELETE /identity/v3/users/b79ae3845ef74b25a69995bbd495ce82 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:31.696359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.696835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.696934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.718610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:31.719295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:31.806174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 964/1922] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:31.817973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:31.819496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:31.892647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f05c00-73d4-4a62-bbe3-17a9c7253abd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:31.897005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:31.898001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:31.898354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:31.898811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:31.909404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:31.911071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:31.929240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 959/1923] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:32.459263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.465180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:32.479074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878dd00-e99d-44bc-a1dd-a7431e90862e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.486099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.486841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.487265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.487511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] PATH_INFO: `/v3/projects/1921d7f183c54cb3801d9c10a0594be9` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.488859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1921d7f183c54cb3801d9c10a0594be9)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:32.491049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:32.560142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1921d7f183c54cb3801d9c10a0594be9', 'request_id': 'req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.568633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1921d7f183c54cb3801d9c10a0594be9', 'request_id': 'req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.576678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1921d7f183c54cb3801d9c10a0594be9', 'request_id': 'req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.592788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] The token cache is being invalidate because project 1921d7f183c54cb3801d9c10a0594be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:32.593089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.593646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.595567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 965/1924] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:32 2022] DELETE /identity/v3/projects/1921d7f183c54cb3801d9c10a0594be9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:32.599896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:32.614044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37d01-43d7-466f-bd06-917f9fe3378e service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:32.730141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:32.730991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:32.731408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:32.731689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] PATH_INFO: `/v3/users/47317b84ff3848518a1f9e3642ac7bad` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:32.733406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47317b84ff3848518a1f9e3642ac7bad)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:32.735930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:32.790068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47317b84ff3848518a1f9e3642ac7bad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.798618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47317b84ff3848518a1f9e3642ac7bad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.799642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47317b84ff3848518a1f9e3642ac7bad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.819263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:32.823773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47317b84ff3848518a1f9e3642ac7bad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.841587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa331dcf-b5f0-4b7d-955a-df80b80b1d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47317b84ff3848518a1f9e3642ac7bad'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:32.856883 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 960/1925] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:32 2022] DELETE /identity/v3/users/47317b84ff3848518a1f9e3642ac7bad => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:33.248852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.250597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:33.277910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da7d7-f97d-4d2b-afc3-9f8ac01ee344 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.350225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.351055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.351832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.352121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] PATH_INFO: `/v3/projects/4ba1738f7e4546b1b90826caf95192d1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.354317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba1738f7e4546b1b90826caf95192d1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.357405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.386146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:33.424883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba1738f7e4546b1b90826caf95192d1', 'request_id': 'req-148761b8-5ecc-4f78-b5b9-51153f5052d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:33.435705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba1738f7e4546b1b90826caf95192d1', 'request_id': 'req-148761b8-5ecc-4f78-b5b9-51153f5052d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:33.452590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba1738f7e4546b1b90826caf95192d1', 'request_id': 'req-148761b8-5ecc-4f78-b5b9-51153f5052d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:33.457545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] The token cache is being invalidate because project 4ba1738f7e4546b1b90826caf95192d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:33.458009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:33.458705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-148761b8-5ecc-4f78-b5b9-51153f5052d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:33.460375 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 966/1926] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:33 2022] DELETE /identity/v3/projects/4ba1738f7e4546b1b90826caf95192d1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:33.465449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686046b-d4fb-4232-89ba-a4e5b66b26e4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.465745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686046b-d4fb-4232-89ba-a4e5b66b26e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.466058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686046b-d4fb-4232-89ba-a4e5b66b26e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.485509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4686046b-d4fb-4232-89ba-a4e5b66b26e4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:33.486756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4686046b-d4fb-4232-89ba-a4e5b66b26e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:33.548794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 961/1927] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:33.557081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1f3e4-f073-426a-a15d-afa7d6f30572 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.557467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1f3e4-f073-426a-a15d-afa7d6f30572 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.557811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1f3e4-f073-426a-a15d-afa7d6f30572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.579898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4ab1f3e4-f073-426a-a15d-afa7d6f30572 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:33.581219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4ab1f3e4-f073-426a-a15d-afa7d6f30572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:33.590976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 967/1928] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:33.597316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686046b-d4fb-4232-89ba-a4e5b66b26e4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.607490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686046b-d4fb-4232-89ba-a4e5b66b26e4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.613139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.613795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.614114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.614389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.615095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:33.615433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.617100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.633665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 962/1929] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:33.635281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1f3e4-f073-426a-a15d-afa7d6f30572 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.645562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1f3e4-f073-426a-a15d-afa7d6f30572 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.650368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.651093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.651432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.651765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.652496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.654498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.684246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 968/1930] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:33 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:33.688440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.698958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a41356-6c07-45c4-8e11-b31761b77a88 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.757295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.757964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.758250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.758528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.759202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.761150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.782184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 963/1931] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:33 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:33.786745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.797190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10ce7-7ef5-4431-9072-57d32be1a062 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.802423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.803047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.803326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.803602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.804387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.806086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.816174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 969/1932] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:33.820660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.835658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e8baa-cd60-4063-81bc-3f1a080caa61 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.842696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de8f41-d704-4ed8-a0c9-544b02e045a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.843574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de8f41-d704-4ed8-a0c9-544b02e045a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.843958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de8f41-d704-4ed8-a0c9-544b02e045a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.844343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de8f41-d704-4ed8-a0c9-544b02e045a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.845358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de8f41-d704-4ed8-a0c9-544b02e045a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.847561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de8f41-d704-4ed8-a0c9-544b02e045a8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.859598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 964/1933] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:33.863659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:33.874317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685bc85-a3cb-40c8-9b1a-9d6298d5b84e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:33.879028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:33.879659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.879937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.880210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] PATH_INFO: `/v3/projects/6ee5b8f085e34798bac8383bda5b4cf4/users/5d3efaa5192940689425bdb67dbdec2a/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.897480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee5b8f085e34798bac8383bda5b4cf4, user_id=5d3efaa5192940689425bdb67dbdec2a, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:33.900569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:33.932604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 970/1934] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:33 2022] PUT /identity/v3/projects/6ee5b8f085e34798bac8383bda5b4cf4/users/5d3efaa5192940689425bdb67dbdec2a/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:33.932919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163867d-e595-4108-b935-6e740de9b70b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:33.933352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163867d-e595-4108-b935-6e740de9b70b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:33.933792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163867d-e595-4108-b935-6e740de9b70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:33.975466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5163867d-e595-4108-b935-6e740de9b70b None None] MFA Rules not processed for user `5d3efaa5192940689425bdb67dbdec2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:33.977720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5163867d-e595-4108-b935-6e740de9b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:34.044940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:34.141766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 965/1935] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:34.146866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.270265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596ece5-c14c-4e48-8875-9584eb4b90fa admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.277155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.278054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.278400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.278748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.279668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.281845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.330793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 971/1936] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:34 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:34.332253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163867d-e595-4108-b935-6e740de9b70b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.348074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163867d-e595-4108-b935-6e740de9b70b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.490261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.509234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.510177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.511784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.517741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.521383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.532456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.535009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:34.550452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0eeb8-8a87-44c0-84ad-c21a06102f3a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.556379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 966/1937] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:34 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:34.556569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.557296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.557577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.557855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] PATH_INFO: `/v3/users/4519af595bd8422699ef13242565087a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.558396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.559263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4519af595bd8422699ef13242565087a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.562026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.572751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97daed-27ca-4b74-bc43-e648e5c7f4a5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.578291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.579205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.579539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.579909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.580833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.582768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.593560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:34.596078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 967/1938] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:34.601659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.621833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b993f-9d52-4052-8a66-9cd1aaeca105 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.627791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4519af595bd8422699ef13242565087a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:34.629413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.630157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.630441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.630718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] PATH_INFO: `/v3/projects/de8e924d439a4b65ab3a64f608c0d4fa/users/6c4a894fdc4a43e795cc1b83013d444d/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.637970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4519af595bd8422699ef13242565087a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:34.648712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8e924d439a4b65ab3a64f608c0d4fa, user_id=6c4a894fdc4a43e795cc1b83013d444d, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.651456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.654353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4519af595bd8422699ef13242565087a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:34.655423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4519af595bd8422699ef13242565087a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:34.664534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d7538c2a-49d2-4a4f-a07d-26992df26a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4519af595bd8422699ef13242565087a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:34.667562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 968/1939] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:34 2022] PUT /identity/v3/projects/de8e924d439a4b65ab3a64f608c0d4fa/users/6c4a894fdc4a43e795cc1b83013d444d/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:34.671542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.673227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:34.673972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 972/1940] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:34 2022] DELETE /identity/v3/users/4519af595bd8422699ef13242565087a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:34.678126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.678611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.679130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.699771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:34.701278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:34.749684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82153044-41ca-4e17-bd02-da0cbce76b8d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.778543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 973/1941] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:34.788543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.790147 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:34.820066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:34.839651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.840521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.840869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.841212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.842029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.843754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.861467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 969/1942] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:34.862441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:34.871381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320fa53-abe7-4791-9e81-882262dec990 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.875908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf888668-00dc-44d1-8cde-1b22ebb433b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.876626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf888668-00dc-44d1-8cde-1b22ebb433b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.876975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf888668-00dc-44d1-8cde-1b22ebb433b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.877318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf888668-00dc-44d1-8cde-1b22ebb433b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.877483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398b37b-ae07-4f46-b242-0e115a4876f5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:34.883489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:34.884239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.884527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.884809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] PATH_INFO: `/v3/projects/de8e924d439a4b65ab3a64f608c0d4fa/users/6c4a894fdc4a43e795cc1b83013d444d/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.887269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8e924d439a4b65ab3a64f608c0d4fa, user_id=6c4a894fdc4a43e795cc1b83013d444d, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.889432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf888668-00dc-44d1-8cde-1b22ebb433b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:34.891035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf888668-00dc-44d1-8cde-1b22ebb433b7 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.893819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:34.902783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 974/1943] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:34.905369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 970/1944] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:34 2022] PUT /identity/v3/projects/de8e924d439a4b65ab3a64f608c0d4fa/users/6c4a894fdc4a43e795cc1b83013d444d/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:34.916419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:34.916700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:34.916979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:34.958102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] MFA Rules not processed for user `6c4a894fdc4a43e795cc1b83013d444d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:34.959260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.001800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:35.049199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 975/1945] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:35.060553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.065185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.135147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412a5e4-4bec-4e88-8f8f-1635cbe79377 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.138794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.139425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.139703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.139975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.149239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.150739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.160575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 971/1946] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:35.198697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.200119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.291082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42401ef8-ab07-40aa-846a-2ab219b0f665 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.296600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.296731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.297006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.297288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] PATH_INFO: `/v3/projects/9b77bb3a6a6342bea25c13d3d86cf216` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.298492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b77bb3a6a6342bea25c13d3d86cf216)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.300431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.370391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b77bb3a6a6342bea25c13d3d86cf216', 'request_id': 'req-6a786302-8289-44e9-9c26-b1d2b03f86a2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.380687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b77bb3a6a6342bea25c13d3d86cf216', 'request_id': 'req-6a786302-8289-44e9-9c26-b1d2b03f86a2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.391119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b77bb3a6a6342bea25c13d3d86cf216', 'request_id': 'req-6a786302-8289-44e9-9c26-b1d2b03f86a2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.405441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] The token cache is being invalidate because project 9b77bb3a6a6342bea25c13d3d86cf216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:35.405737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.406551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.408715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 976/1947] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:35 2022] DELETE /identity/v3/projects/9b77bb3a6a6342bea25c13d3d86cf216 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:35.412794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.428643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa76e9-5fe2-463a-bd2e-0e490aaf9d2d service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.439020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.440439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.504208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.504876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.505172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.505445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] PATH_INFO: `/v3/users/1a0b214bdf18469cae6e835fd8d28c16` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.510443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0b214bdf18469cae6e835fd8d28c16)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.512419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.519597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a786302-8289-44e9-9c26-b1d2b03f86a2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.525373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.525956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.526226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.526496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] PATH_INFO: `/v3/users/4ff3d5d93d8e4922bac10516e183a85b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.527690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff3d5d93d8e4922bac10516e183a85b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.529730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.531575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:35.577088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0b214bdf18469cae6e835fd8d28c16'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.585034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0b214bdf18469cae6e835fd8d28c16'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.585790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0b214bdf18469cae6e835fd8d28c16'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.590553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff3d5d93d8e4922bac10516e183a85b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.598314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:35.599571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0b214bdf18469cae6e835fd8d28c16'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.602786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff3d5d93d8e4922bac10516e183a85b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.608060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0b214bdf18469cae6e835fd8d28c16'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.614774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 972/1948] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:35 2022] DELETE /identity/v3/users/1a0b214bdf18469cae6e835fd8d28c16 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:35.617188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff3d5d93d8e4922bac10516e183a85b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.617959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff3d5d93d8e4922bac10516e183a85b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.619382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.621116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.626177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2b8cbf64-8f9c-4dbb-b5b8-d9f61924308b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff3d5d93d8e4922bac10516e183a85b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.633859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 977/1949] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:35 2022] DELETE /identity/v3/users/4ff3d5d93d8e4922bac10516e183a85b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:35.638039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.638335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.638616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.662906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:35.664875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.697152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff1ed-264c-4793-9171-e8e4f1dcb08e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.739053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 978/1950] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:35.749369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:35.750870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.765949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.766653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.766937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.767208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] PATH_INFO: `/v3/users/5d3efaa5192940689425bdb67dbdec2a` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.768632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3efaa5192940689425bdb67dbdec2a)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.770794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.817473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c26c16-b89f-430b-b2a3-1d2c5b491224 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:35.821666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d1b73-6680-4c45-b84c-dc0b9e6793db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:35.822425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d1b73-6680-4c45-b84c-dc0b9e6793db service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.822770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d1b73-6680-4c45-b84c-dc0b9e6793db service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.823113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d1b73-6680-4c45-b84c-dc0b9e6793db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.833429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d1b73-6680-4c45-b84c-dc0b9e6793db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:35.834741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3efaa5192940689425bdb67dbdec2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.835617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d1b73-6680-4c45-b84c-dc0b9e6793db service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:35.843734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3efaa5192940689425bdb67dbdec2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.844481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3efaa5192940689425bdb67dbdec2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.849296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 979/1951] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:35.859671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3efaa5192940689425bdb67dbdec2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.870565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3efaa5192940689425bdb67dbdec2a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:35.878519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 973/1952] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:35 2022] DELETE /identity/v3/users/5d3efaa5192940689425bdb67dbdec2a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:35.882939 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:35.883387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:35.883661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:35.905255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:35.906718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:35.928081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:36.024641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 980/1953] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:36.044496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.046043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:36.056887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.059694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:36.086364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c3993-29b3-4629-a0f4-29a4966f9f5d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.097838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.098883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.098992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.099222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] PATH_INFO: `/v3/projects/3f4cb8a0737c4142a5365040721f2f2a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.101440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4cb8a0737c4142a5365040721f2f2a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.103774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.129043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:36.192472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4cb8a0737c4142a5365040721f2f2a', 'request_id': 'req-bc70423f-c06d-4e89-bd10-8afeddbb6402'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:36.215544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4cb8a0737c4142a5365040721f2f2a', 'request_id': 'req-bc70423f-c06d-4e89-bd10-8afeddbb6402'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:36.219297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c159c1-7ea8-420f-a982-899c54368cf5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.223205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4cb8a0737c4142a5365040721f2f2a', 'request_id': 'req-bc70423f-c06d-4e89-bd10-8afeddbb6402'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:36.247028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] The token cache is being invalidate because project 3f4cb8a0737c4142a5365040721f2f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:36.247346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:36.248391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-bc70423f-c06d-4e89-bd10-8afeddbb6402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:36.263726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 981/1954] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:36 2022] DELETE /identity/v3/projects/3f4cb8a0737c4142a5365040721f2f2a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:36.271576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e7fd-3251-4d7d-942d-18033a6e86dd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.272034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e7fd-3251-4d7d-942d-18033a6e86dd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.272320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1e7fd-3251-4d7d-942d-18033a6e86dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.359177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0ea1e7fd-3251-4d7d-942d-18033a6e86dd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:36.361139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.364239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.366143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.366945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.367766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0ea1e7fd-3251-4d7d-942d-18033a6e86dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:36.373454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:36.478908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 982/1955] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:36.489028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8c50-182f-406d-84d8-5be383bb6378 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.489325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8c50-182f-406d-84d8-5be383bb6378 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.490432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf8c50-182f-406d-84d8-5be383bb6378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.529437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-eebf8c50-182f-406d-84d8-5be383bb6378 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:36.530866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-eebf8c50-182f-406d-84d8-5be383bb6378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:36.539712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.541565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.554099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 983/1956] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:36.562591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf8c50-182f-406d-84d8-5be383bb6378 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.563368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 974/1957] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:36.579811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf8c50-182f-406d-84d8-5be383bb6378 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.585190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.586208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.586591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.587143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.588003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:36.588579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.590558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.616600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.630405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 984/1958] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:36.632165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb2a66-6710-4b51-9bae-830ad7a943f0 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.638351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.639057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.639389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.640001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.640350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.642622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.677987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 975/1959] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:36 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:36.679181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.691549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ddeea-9659-44c3-be85-01eb4dbbf5d0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.722192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:36.762983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.763817 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.763930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.764156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.764837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.766810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.796316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 985/1960] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:36 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:36.800735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.811697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3534c-825e-45e7-bf09-8d44cce8eec4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.816457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.817154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.817463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.817740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.818990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.820178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.833092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 976/1961] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:36.838476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.860082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a2a00-442c-49a8-97a2-ac7538d11c17 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.867760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a283c-2644-4f86-9902-f29d5efa6c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.869174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a283c-2644-4f86-9902-f29d5efa6c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.869804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a283c-2644-4f86-9902-f29d5efa6c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.870129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a283c-2644-4f86-9902-f29d5efa6c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.871110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a283c-2644-4f86-9902-f29d5efa6c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.872998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a283c-2644-4f86-9902-f29d5efa6c3d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.891162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 986/1962] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:36.892187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.907487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a36a-b9a9-431d-b3eb-96fa38a5d674 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:36.913317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:36.914071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.914350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.914623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] PATH_INFO: `/v3/projects/5d6184efbb964246abe8071c33f46f00/users/908f50359bd744b7b6ae3a1b2db36459/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.935380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6184efbb964246abe8071c33f46f00, user_id=908f50359bd744b7b6ae3a1b2db36459, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:36.938101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:36.962415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 977/1963] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:36 2022] PUT /identity/v3/projects/5d6184efbb964246abe8071c33f46f00/users/908f50359bd744b7b6ae3a1b2db36459/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:36.973080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:36.973401 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:36.973635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:36.986650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:36.988689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.014732 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] MFA Rules not processed for user `908f50359bd744b7b6ae3a1b2db36459`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:37.016067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.054023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.130470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0b58d-2ffb-4bdc-8c72-78afb203282a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.137592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.138308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.138588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.138959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] PATH_INFO: `/v3/projects/9cd996196b14457c9bca5cec413aa846` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.140383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd996196b14457c9bca5cec413aa846)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.143584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.175272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 987/1964] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:37.180140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.182187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.210961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea336d32-25f9-4cc7-a5e9-ca456bc35502 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.224677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.225368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.226316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.226642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] PATH_INFO: `/v3/projects/6ee5b8f085e34798bac8383bda5b4cf4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.228108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee5b8f085e34798bac8383bda5b4cf4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.229777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.236315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd996196b14457c9bca5cec413aa846', 'request_id': 'req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.255787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd996196b14457c9bca5cec413aa846', 'request_id': 'req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.283327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd996196b14457c9bca5cec413aa846', 'request_id': 'req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.303668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] The token cache is being invalidate because project 9cd996196b14457c9bca5cec413aa846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:37.303921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.304573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.306654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 978/1965] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:36 2022] DELETE /identity/v3/projects/9cd996196b14457c9bca5cec413aa846 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:37.307232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.310632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.320391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee5b8f085e34798bac8383bda5b4cf4', 'request_id': 'req-0831264c-22bc-47a1-96d9-f597585f8cd0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.334379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee5b8f085e34798bac8383bda5b4cf4', 'request_id': 'req-0831264c-22bc-47a1-96d9-f597585f8cd0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.341651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee5b8f085e34798bac8383bda5b4cf4', 'request_id': 'req-0831264c-22bc-47a1-96d9-f597585f8cd0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.355019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] The token cache is being invalidate because project 6ee5b8f085e34798bac8383bda5b4cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:37.355322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.356031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.358119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 988/1966] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:37 2022] DELETE /identity/v3/projects/6ee5b8f085e34798bac8383bda5b4cf4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:37.359914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.363000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.384457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd83b3c-b6d6-4c2e-beb5-6321700add3e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.387756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.460936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.461600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.461890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.462295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.463137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.465098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.472002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:37.484454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831264c-22bc-47a1-96d9-f597585f8cd0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.490096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.490953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.491645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.492217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] PATH_INFO: `/v3/users/55268d62ef154c6a9145857f12dc9a05` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.493642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55268d62ef154c6a9145857f12dc9a05)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.496088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.539623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 979/1967] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:37 2022] POST /identity/v3/projects => generated 377 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:37.541708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.568415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.577894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55268d62ef154c6a9145857f12dc9a05'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.595371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55268d62ef154c6a9145857f12dc9a05'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.623620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55268d62ef154c6a9145857f12dc9a05'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.624363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55268d62ef154c6a9145857f12dc9a05'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.634393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55268d62ef154c6a9145857f12dc9a05'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.642246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 989/1968] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:37 2022] DELETE /identity/v3/users/55268d62ef154c6a9145857f12dc9a05 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:37.644281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.645951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.692941 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d2802-6c45-4dc0-bf99-adcc703131f8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.778365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.779384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.779675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.780112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] PATH_INFO: `/v3/users/6c4a894fdc4a43e795cc1b83013d444d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.781362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4a894fdc4a43e795cc1b83013d444d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.783712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.807580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1366d07-908e-48da-8070-0a326d439e8b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.813869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.814826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.815213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.815752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.816489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.818865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.844710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4a894fdc4a43e795cc1b83013d444d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.846426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 990/1969] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:37 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:37.850509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.856522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4a894fdc4a43e795cc1b83013d444d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.858004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4a894fdc4a43e795cc1b83013d444d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.861735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec30be3-bdbc-4f1b-b229-fddde8c34f17 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.880085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4a894fdc4a43e795cc1b83013d444d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.883355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:37.884771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:37.885050 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:37.885316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:37.886099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:37.889033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:37.894262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4a894fdc4a43e795cc1b83013d444d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:37.905609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 991/1971] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:37.906578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:37.909644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:37.917625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 980/1971] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:37 2022] DELETE /identity/v3/users/6c4a894fdc4a43e795cc1b83013d444d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:37.926137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ac7ac-9922-402e-ac01-0c23acba8444 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:37.938895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.017760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.018354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.018816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.018907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] PATH_INFO: `/v3/projects/7b4c1d96c0234aa5b70b45e31c67cac6/users/c1a0e2ee9a2343dcada6766e46302f81/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.030861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.032790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.042560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4c1d96c0234aa5b70b45e31c67cac6, user_id=c1a0e2ee9a2343dcada6766e46302f81, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.045426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.066527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e20d9c-ff6a-4ea5-af7d-c8174aeb8fab admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.068295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 992/1972] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:37 2022] PUT /identity/v3/projects/7b4c1d96c0234aa5b70b45e31c67cac6/users/c1a0e2ee9a2343dcada6766e46302f81/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:38.072004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.083129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.137794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.138556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.138848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.139125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] PATH_INFO: `/v3/projects/c709aa0cf3f74179add0369e4db28d00` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.140357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c709aa0cf3f74179add0369e4db28d00)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.142608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.159417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071d89-78ff-47f8-9dd7-5f496a605fe2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.164945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.165802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.166377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.166654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.167361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.169093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.184102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 993/1973] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:38.186185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.203166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38074ba3-9a36-49b0-9d46-03173028708b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.218457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c709aa0cf3f74179add0369e4db28d00', 'request_id': 'req-fa58b27c-d952-4fc8-babd-103e1d98b2fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.228938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c709aa0cf3f74179add0369e4db28d00', 'request_id': 'req-fa58b27c-d952-4fc8-babd-103e1d98b2fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.235321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c709aa0cf3f74179add0369e4db28d00', 'request_id': 'req-fa58b27c-d952-4fc8-babd-103e1d98b2fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.250573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] The token cache is being invalidate because project c709aa0cf3f74179add0369e4db28d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:38.250861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.251544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.253226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 981/1974] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:38 2022] DELETE /identity/v3/projects/c709aa0cf3f74179add0369e4db28d00 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:38.257787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.259159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.292594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f37ba6-a36b-41b5-8d7e-17bf63d9492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.294273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37ba6-a36b-41b5-8d7e-17bf63d9492e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.294562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37ba6-a36b-41b5-8d7e-17bf63d9492e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.294839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f37ba6-a36b-41b5-8d7e-17bf63d9492e admin admin] PATH_INFO: `/v3/projects/7b4c1d96c0234aa5b70b45e31c67cac6/users/c1a0e2ee9a2343dcada6766e46302f81/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.297645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f37ba6-a36b-41b5-8d7e-17bf63d9492e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4c1d96c0234aa5b70b45e31c67cac6, user_id=c1a0e2ee9a2343dcada6766e46302f81, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.301531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f37ba6-a36b-41b5-8d7e-17bf63d9492e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.317880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 994/1975] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:38 2022] PUT /identity/v3/projects/7b4c1d96c0234aa5b70b45e31c67cac6/users/c1a0e2ee9a2343dcada6766e46302f81/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:38.319877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c393-dd37-48ac-a7b7-89600dc565db None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.320167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c393-dd37-48ac-a7b7-89600dc565db None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.320446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c393-dd37-48ac-a7b7-89600dc565db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.343115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b27c-d952-4fc8-babd-103e1d98b2fe admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.344160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-cdc7c393-dd37-48ac-a7b7-89600dc565db None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:38.348876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cdc7c393-dd37-48ac-a7b7-89600dc565db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.384866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.422890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.452031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.452956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.453585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.453955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] PATH_INFO: `/v3/projects/de8e924d439a4b65ab3a64f608c0d4fa` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.455332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8e924d439a4b65ab3a64f608c0d4fa)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.457505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.458517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 995/1976] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:38.461679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37307f-8a00-4bce-a067-19c87e91480d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.461990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37307f-8a00-4bce-a067-19c87e91480d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.462266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37307f-8a00-4bce-a067-19c87e91480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.501218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3e37307f-8a00-4bce-a067-19c87e91480d None None] MFA Rules not processed for user `c1a0e2ee9a2343dcada6766e46302f81`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:38.502561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3e37307f-8a00-4bce-a067-19c87e91480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.545623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8e924d439a4b65ab3a64f608c0d4fa', 'request_id': 'req-80b25550-65e5-47e9-8539-b9f5136a8e68'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.560099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8e924d439a4b65ab3a64f608c0d4fa', 'request_id': 'req-80b25550-65e5-47e9-8539-b9f5136a8e68'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.571069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8e924d439a4b65ab3a64f608c0d4fa', 'request_id': 'req-80b25550-65e5-47e9-8539-b9f5136a8e68'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.586040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] The token cache is being invalidate because project de8e924d439a4b65ab3a64f608c0d4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:38.587266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.588254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-80b25550-65e5-47e9-8539-b9f5136a8e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:38.591024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 982/1977] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:38 2022] DELETE /identity/v3/projects/de8e924d439a4b65ab3a64f608c0d4fa => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:38.592533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.592811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.593083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.609946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 996/1978] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:38.615538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf29c3-bfd5-4a9b-9b26-62263babd54a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.615913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf29c3-bfd5-4a9b-9b26-62263babd54a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.616526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf29c3-bfd5-4a9b-9b26-62263babd54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.619050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:38.620818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.642509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e0bf29c3-bfd5-4a9b-9b26-62263babd54a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:38.644265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e0bf29c3-bfd5-4a9b-9b26-62263babd54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.702203 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 983/1979] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:38.703173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.704427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.716532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 997/1980] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:38.717636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf29c3-bfd5-4a9b-9b26-62263babd54a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.737181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf29c3-bfd5-4a9b-9b26-62263babd54a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.751234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e07f9-6428-4979-b571-673f5ce935bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.752221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e07f9-6428-4979-b571-673f5ce935bd admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.752969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e07f9-6428-4979-b571-673f5ce935bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.754066 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e07f9-6428-4979-b571-673f5ce935bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.754974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e07f9-6428-4979-b571-673f5ce935bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:38.755289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e07f9-6428-4979-b571-673f5ce935bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.757005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e07f9-6428-4979-b571-673f5ce935bd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.773252 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 998/1981] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:38.775477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9482-77d4-4348-a529-389cbdaae1de None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.775477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9482-77d4-4348-a529-389cbdaae1de None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.775944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb9482-77d4-4348-a529-389cbdaae1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.789980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994e53-2975-4bb8-9ee7-37e099cb48fe None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.792188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.792905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.793088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.793361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.795292 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.823421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-79cb9482-77d4-4348-a529-389cbdaae1de None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:38.824618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-79cb9482-77d4-4348-a529-389cbdaae1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:38.833228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 999/1982] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:38.833837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9482-77d4-4348-a529-389cbdaae1de None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.844258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb9482-77d4-4348-a529-389cbdaae1de None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.848625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.849110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.849791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.850198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.850473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.851275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.853332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.883360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.884973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.896375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 984/1983] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:38.897757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.909841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82503ce6-8a58-4611-b595-3c03e17cbd91 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:38.916066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:38.917361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:38.917361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:38.917841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:38.918797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:38.919201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:38.921549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:38.926349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1000/1984] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:38.931673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.943143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 985/1985] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:38.944585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:38.958367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:38.968685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fd3db-8ce5-4653-9e32-3beb6d5abd2f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.041577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e0074-d0de-4679-b69a-e8f907a6ea31 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.071998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.072737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.073728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.074047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.074854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.077475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.095889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.096626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.097001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.097345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.098243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.100764 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.105877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1001/1986] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:39.110341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.121324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff51ac-be5e-4625-b2ea-50d5e9309c41 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.127338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.128023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.128304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.128636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.129725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.131448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.145139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1002/1987] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:39.150358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.154207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 986/1988] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:38 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:39.155848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.166048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fd9f6-74aa-48a1-9579-e28048c64c44 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.250249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.251394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.251815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.252327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.253548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.256503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.259317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5b23a-c937-4944-9483-51e782a48f1a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.264773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.265594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.265967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.266738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.267786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.270145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.274830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1003/1989] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:39.278727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.292164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59e2e5-91e5-4efd-a9e8-b002d05256df admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.298745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96340d8a-6700-4fe8-a765-9de072d0bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.299570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340d8a-6700-4fe8-a765-9de072d0bb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.302546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 987/1990] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:39.305837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340d8a-6700-4fe8-a765-9de072d0bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.306171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96340d8a-6700-4fe8-a765-9de072d0bb05 admin admin] PATH_INFO: `/v3/projects/388feeca8634404898d26db9b832f308/users/37d71dcd8b5c4eee947a517b362d156d/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.307919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.319804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a94a8-aee4-46fd-ad5b-fa10224a8f49 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.324763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.325333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.325617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.326047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.326785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.328251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96340d8a-6700-4fe8-a765-9de072d0bb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388feeca8634404898d26db9b832f308, user_id=37d71dcd8b5c4eee947a517b362d156d, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.328502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.331497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96340d8a-6700-4fe8-a765-9de072d0bb05 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.339386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 988/1991] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:39.344421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.350581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1004/1992] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:39 2022] PUT /identity/v3/projects/388feeca8634404898d26db9b832f308/users/37d71dcd8b5c4eee947a517b362d156d/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:39.356572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b335808-aaf1-4240-be72-d128359ab89d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.362081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc816-c5b9-46da-908a-2a9691fc1a39 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.362334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc816-c5b9-46da-908a-2a9691fc1a39 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.362615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc816-c5b9-46da-908a-2a9691fc1a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.385165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:39.392920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-406cc816-c5b9-46da-908a-2a9691fc1a39 None None] MFA Rules not processed for user `37d71dcd8b5c4eee947a517b362d156d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:39.393403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-406cc816-c5b9-46da-908a-2a9691fc1a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:39.421999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.422889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.423215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.423490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.424217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.425866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.435857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 989/1993] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:39.440228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.449596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16a2a-060b-4b09-91f2-42f0b74c26ed admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.451231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:39.454705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524a44c-8a1f-41ff-be28-a0098b54288b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.455360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a44c-8a1f-41ff-be28-a0098b54288b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.455637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a44c-8a1f-41ff-be28-a0098b54288b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.455909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524a44c-8a1f-41ff-be28-a0098b54288b admin admin] PATH_INFO: `/v3/projects/077630fd75f94a1bb25045f59a08b93c/users/16bc10a1ebef494fbcd00002513b056e/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.462782 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1005/1994] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:39.467585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc816-c5b9-46da-908a-2a9691fc1a39 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.472710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524a44c-8a1f-41ff-be28-a0098b54288b admin admin] RBAC: Authorizing `identity:create_grant(project_id=077630fd75f94a1bb25045f59a08b93c, user_id=16bc10a1ebef494fbcd00002513b056e, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.475566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524a44c-8a1f-41ff-be28-a0098b54288b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.478754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc816-c5b9-46da-908a-2a9691fc1a39 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.483749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.484374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.484656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.484920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.485596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.487701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.489405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 990/1995] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:39 2022] PUT /identity/v3/projects/077630fd75f94a1bb25045f59a08b93c/users/16bc10a1ebef494fbcd00002513b056e/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:39.501112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4f84-a069-46b4-89b8-4067959dbc49 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.501405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4f84-a069-46b4-89b8-4067959dbc49 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.501680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4f84-a069-46b4-89b8-4067959dbc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.523325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1006/1996] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:39.524301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.531265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-31bd4f84-a069-46b4-89b8-4067959dbc49 None None] MFA Rules not processed for user `16bc10a1ebef494fbcd00002513b056e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:39.532474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-31bd4f84-a069-46b4-89b8-4067959dbc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:39.591855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c6c41-9831-4fd5-8535-96a5960fa5a3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.596988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.597622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.597898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.598200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.598860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.601046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.606172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 991/1997] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:39.610506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4f84-a069-46b4-89b8-4067959dbc49 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.622161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4f84-a069-46b4-89b8-4067959dbc49 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.627015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.627857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.628202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.628478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.629146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.630825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1007/1998] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:39.631184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.635920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.646830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a41a4-850a-4a08-908a-f97895dfca29 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.652174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.652944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.653311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.653796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.654554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.656382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.660516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 992/1999] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:39.664932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.675113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1008/2000] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:39.676116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.687697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714143-710e-4974-855b-edcfd34c2c2a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.734252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a0b95-303d-4ebb-8789-c5d5fe98ad7b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.738926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.739549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.739851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.740122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.740830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.742859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.754345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:39.754919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.755838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.756140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.756389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] PATH_INFO: `/v3/projects/5579bc1b484945bca8f6199e33ab6c14/users/12a1646b8bcc47978ec3ff7b5279fe2e/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.769975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 993/2001] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:39.771512 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.774113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5579bc1b484945bca8f6199e33ab6c14, user_id=12a1646b8bcc47978ec3ff7b5279fe2e, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.776803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.781254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f117f7-84b3-4174-a5cf-f719fec98ac3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.786218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.786839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.787117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.787420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.788136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.789829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.791042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1009/2002] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:39 2022] PUT /identity/v3/projects/5579bc1b484945bca8f6199e33ab6c14/users/12a1646b8bcc47978ec3ff7b5279fe2e/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:39.795276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.804380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 994/2003] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:39.808553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.818251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a13ea-a648-4452-83fb-ba227c792f6c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.829976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:39.862237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98151bb4-381b-4cc0-a403-30827a10c0de admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.867585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.868218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.868500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.868773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.869840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.871499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.874126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.874908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.875191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.875467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] PATH_INFO: `/v3/projects/f92f26a8244d40ca869fda5062e6794d/users/e91a3027d4b14700a188cc58a44d6cdf/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.885505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1010/2004] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:39.886628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.891190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92f26a8244d40ca869fda5062e6794d, user_id=e91a3027d4b14700a188cc58a44d6cdf, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.893857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.896144 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490708b-3ebe-4967-812b-34f0bf787ad8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:39.901140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201834f3-b00d-4bd1-b019-f8afa6b65290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:39.901882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201834f3-b00d-4bd1-b019-f8afa6b65290 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.902260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201834f3-b00d-4bd1-b019-f8afa6b65290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.902557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201834f3-b00d-4bd1-b019-f8afa6b65290 admin admin] PATH_INFO: `/v3/projects/5579bc1b484945bca8f6199e33ab6c14/users/12a1646b8bcc47978ec3ff7b5279fe2e/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.904509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201834f3-b00d-4bd1-b019-f8afa6b65290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5579bc1b484945bca8f6199e33ab6c14, user_id=12a1646b8bcc47978ec3ff7b5279fe2e, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:39.907043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 995/2005] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:39 2022] PUT /identity/v3/projects/f92f26a8244d40ca869fda5062e6794d/users/e91a3027d4b14700a188cc58a44d6cdf/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:39.907286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201834f3-b00d-4bd1-b019-f8afa6b65290 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:39.910987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:39.917664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1011/2006] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:39 2022] PUT /identity/v3/projects/5579bc1b484945bca8f6199e33ab6c14/users/12a1646b8bcc47978ec3ff7b5279fe2e/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:39.927958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839d5cd-79b9-44ed-9348-c04c72c65419 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:39.928242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839d5cd-79b9-44ed-9348-c04c72c65419 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:39.928516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839d5cd-79b9-44ed-9348-c04c72c65419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:39.958479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a839d5cd-79b9-44ed-9348-c04c72c65419 None None] MFA Rules not processed for user `12a1646b8bcc47978ec3ff7b5279fe2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:39.959585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a839d5cd-79b9-44ed-9348-c04c72c65419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:39.980078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eb0c1-a712-446b-9313-59ee5df5dd0c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.036992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1012/2007] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:40.037208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.037829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.038192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.038467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.039170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.041085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.048192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839d5cd-79b9-44ed-9348-c04c72c65419 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.051628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 996/2008] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:40.055688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.065600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad7bf2-2ae6-490c-9bef-c976445454d5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.070848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49925574-e283-4189-92eb-07cd77a92231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.071537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925574-e283-4189-92eb-07cd77a92231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.071818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925574-e283-4189-92eb-07cd77a92231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.072090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49925574-e283-4189-92eb-07cd77a92231 admin admin] PATH_INFO: `/v3/projects/f92f26a8244d40ca869fda5062e6794d/users/e91a3027d4b14700a188cc58a44d6cdf/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.074144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49925574-e283-4189-92eb-07cd77a92231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92f26a8244d40ca869fda5062e6794d, user_id=e91a3027d4b14700a188cc58a44d6cdf, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.076771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49925574-e283-4189-92eb-07cd77a92231 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.083516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:40.091653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 997/2009] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:40 2022] PUT /identity/v3/projects/f92f26a8244d40ca869fda5062e6794d/users/e91a3027d4b14700a188cc58a44d6cdf/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:40.104005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.104005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.104005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.107532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839d5cd-79b9-44ed-9348-c04c72c65419 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.131820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] MFA Rules not processed for user `e91a3027d4b14700a188cc58a44d6cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:40.132928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:40.158110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.158746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.159021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.159291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.168908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:40.215639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 998/2010] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:40.234379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.235850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.247597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.248992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:40.251265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1013/2011] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:40.261458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3984e68-2301-4666-9aad-8b6f9e2ac97d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.265913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.269966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.270310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.270595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.283380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.284952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.302129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 999/2012] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:40.381264 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.390455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbb593-a2d5-4f03-97cb-b4c2782fef4d service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.394870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.395555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.395837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.396094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.411274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.420396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733ff42-01f2-4e27-ac3e-8956750aa63b service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.424146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.425153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.425519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.425841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.427702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:40.465811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.467353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.477482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1014/2013] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:40.498455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.501473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.515844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1000/2014] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:40.566476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:40.576292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8f93d-ad14-4f47-a226-ed18715093ce service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:40.580585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f58e72-4aae-4b5c-96f1-0c03889cf243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:40.581211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58e72-4aae-4b5c-96f1-0c03889cf243 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:40.581489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58e72-4aae-4b5c-96f1-0c03889cf243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:40.581758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f58e72-4aae-4b5c-96f1-0c03889cf243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:40.655575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58e72-4aae-4b5c-96f1-0c03889cf243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:40.657199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f58e72-4aae-4b5c-96f1-0c03889cf243 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:40.667176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1015/2015] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:41.140481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:41.211090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d686620-8eb8-466b-b1be-42a9488338ef service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:41.215459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:41.216175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:41.216531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:41.216963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] PATH_INFO: `/v3/users/16bc10a1ebef494fbcd00002513b056e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:41.218398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16bc10a1ebef494fbcd00002513b056e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:41.220363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:41.226748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:41.276569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16bc10a1ebef494fbcd00002513b056e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:41.293792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16bc10a1ebef494fbcd00002513b056e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:41.297942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16bc10a1ebef494fbcd00002513b056e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:41.320386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16bc10a1ebef494fbcd00002513b056e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:41.332107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16bc10a1ebef494fbcd00002513b056e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:41.344593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1001/2016] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:41 2022] DELETE /identity/v3/users/16bc10a1ebef494fbcd00002513b056e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:41.345555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:41.345849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:41.346157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:41.368493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:41.370126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:41.414965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:41.440159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1016/2017] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:41.457106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:41.458791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:41.527862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945a09e-435f-43f4-ac62-e5092b1cbe92 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:41.532817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:41.533157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:41.533439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:41.533708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:41.544483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:41.546040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:41.558041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1002/2018] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:41.972121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:41.978728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:42.009052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e5384-de57-4e71-9da8-59ce12a14c4a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:42.025820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:42.027956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:42.028301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:42.028989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] PATH_INFO: `/v3/projects/077630fd75f94a1bb25045f59a08b93c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:42.031424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077630fd75f94a1bb25045f59a08b93c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:42.038377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:42.161182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077630fd75f94a1bb25045f59a08b93c', 'request_id': 'req-ce850601-477b-4053-b9c2-df547cd1c638'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.172133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077630fd75f94a1bb25045f59a08b93c', 'request_id': 'req-ce850601-477b-4053-b9c2-df547cd1c638'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.188575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077630fd75f94a1bb25045f59a08b93c', 'request_id': 'req-ce850601-477b-4053-b9c2-df547cd1c638'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.205060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] The token cache is being invalidate because project 077630fd75f94a1bb25045f59a08b93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:42.205393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.206210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.208078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1017/2019] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:41 2022] DELETE /identity/v3/projects/077630fd75f94a1bb25045f59a08b93c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:42.212295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:42.227320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d70c3-4bce-449d-8994-1bf1a8819fb8 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:42.313299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:42.314341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:42.314838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:42.315550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] PATH_INFO: `/v3/users/e91a3027d4b14700a188cc58a44d6cdf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:42.317795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91a3027d4b14700a188cc58a44d6cdf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:42.320441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:42.362352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:42.388620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91a3027d4b14700a188cc58a44d6cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.398026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91a3027d4b14700a188cc58a44d6cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.398752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91a3027d4b14700a188cc58a44d6cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.412466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91a3027d4b14700a188cc58a44d6cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.431626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c7f94b93-c88d-464f-98c3-d3ef3d4bac26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91a3027d4b14700a188cc58a44d6cdf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.441475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1003/2020] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:42 2022] DELETE /identity/v3/users/e91a3027d4b14700a188cc58a44d6cdf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:42.743343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:42.745350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:42.765404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce850601-477b-4053-b9c2-df547cd1c638 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:42.836984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:42.837754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:42.838132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:42.838495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] PATH_INFO: `/v3/projects/f92f26a8244d40ca869fda5062e6794d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:42.839777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92f26a8244d40ca869fda5062e6794d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:42.841814 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:42.911730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92f26a8244d40ca869fda5062e6794d', 'request_id': 'req-579509d5-57e2-42ee-abb3-f6068ed4bb88'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.926841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92f26a8244d40ca869fda5062e6794d', 'request_id': 'req-579509d5-57e2-42ee-abb3-f6068ed4bb88'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.934937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92f26a8244d40ca869fda5062e6794d', 'request_id': 'req-579509d5-57e2-42ee-abb3-f6068ed4bb88'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.947219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:42.955771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] The token cache is being invalidate because project f92f26a8244d40ca869fda5062e6794d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:42.956266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.957429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-579509d5-57e2-42ee-abb3-f6068ed4bb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:42.962080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1018/2021] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:42 2022] DELETE /identity/v3/projects/f92f26a8244d40ca869fda5062e6794d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:42.964658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72b3c6-2374-443a-804e-17601b16c3e7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:42.964980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72b3c6-2374-443a-804e-17601b16c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:42.965366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72b3c6-2374-443a-804e-17601b16c3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:42.985849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0b72b3c6-2374-443a-804e-17601b16c3e7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:42.987211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0b72b3c6-2374-443a-804e-17601b16c3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:43.052784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1004/2022] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:43.061846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c22405-4df8-424f-8723-94099a40e28c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.062155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c22405-4df8-424f-8723-94099a40e28c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.062504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c22405-4df8-424f-8723-94099a40e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.086121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-73c22405-4df8-424f-8723-94099a40e28c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:43.087448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-73c22405-4df8-424f-8723-94099a40e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:43.098733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1019/2023] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:43.100060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72b3c6-2374-443a-804e-17601b16c3e7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.110506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72b3c6-2374-443a-804e-17601b16c3e7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.117596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.118275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.118555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.118828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.119906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:43.120216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.121853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.140453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1005/2024] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:43.141663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c22405-4df8-424f-8723-94099a40e28c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.156509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c22405-4df8-424f-8723-94099a40e28c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.171091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.172212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.172811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.173306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.174395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.178584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.223188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1020/2025] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:43 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:43.228112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.248176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846560f-6270-4a3b-a54f-c0220fafa1d0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.316862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.317501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.317806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.318133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.318801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.321091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.343860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1006/2026] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:43 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:43.348167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.359823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128786c5-255d-4035-b6ca-354484b73c26 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.366468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.368272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.369882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.370275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.371271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.373270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.385943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1021/2027] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:43.389672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.404510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853067-1cb4-4edb-8e5f-78048b8b4814 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.409737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8149acf3-7371-42b0-931d-c412097e5190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.410460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149acf3-7371-42b0-931d-c412097e5190 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.410769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149acf3-7371-42b0-931d-c412097e5190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.411047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8149acf3-7371-42b0-931d-c412097e5190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.411751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149acf3-7371-42b0-931d-c412097e5190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.413473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8149acf3-7371-42b0-931d-c412097e5190 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.424507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1007/2028] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:43.428837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.440545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6ca30-d58e-4b44-b610-1e626e4cf480 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.446567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.447263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.447545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.447818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] PATH_INFO: `/v3/projects/466c5fcf6fca494ab4a80a8cce2306a2/users/c6b4a7ada1894458a0b7ffa1d93044f1/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.463152 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=466c5fcf6fca494ab4a80a8cce2306a2, user_id=c6b4a7ada1894458a0b7ffa1d93044f1, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.465846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.480846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1022/2029] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:43 2022] PUT /identity/v3/projects/466c5fcf6fca494ab4a80a8cce2306a2/users/c6b4a7ada1894458a0b7ffa1d93044f1/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:43.495991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1ac3c-19e0-4cfc-9214-00c721be36da None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.496285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1ac3c-19e0-4cfc-9214-00c721be36da None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.496584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b1ac3c-19e0-4cfc-9214-00c721be36da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.522853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:43.531712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e1b1ac3c-19e0-4cfc-9214-00c721be36da None None] MFA Rules not processed for user `c6b4a7ada1894458a0b7ffa1d93044f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:43.534157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e1b1ac3c-19e0-4cfc-9214-00c721be36da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:43.622588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1008/2030] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:43.628448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.708753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9193378-0281-46e9-8abb-edf99932df7d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.713707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.714387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.714670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.714947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.715625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.717563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.755097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1023/2031] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:43 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:43.757138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1ac3c-19e0-4cfc-9214-00c721be36da None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.772133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b1ac3c-19e0-4cfc-9214-00c721be36da None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.854387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.855245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.855535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.855808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.856480 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.858523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.874290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.876065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:43.885198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1009/2032] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:43 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:43.889746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.900223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c554-6a80-43b8-9c8b-acb6a3e517d3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.905637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.906649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.906649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.906963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.908024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.909270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.923530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1010/2033] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:43.924554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:43.934856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c37b94-a019-440b-8a6a-b74fa78edef2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.940735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.941553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.941900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.942207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] PATH_INFO: `/v3/projects/5c7a84a28e2546e093c84808eeb9a748/users/f8c275e2c7ec4e599734f4d1f568c738/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.947350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ecf52-3cee-468f-81cf-594e7e3732b2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:43.952057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:43.952818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:43.953221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:43.953593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:43.956038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:43.959355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7a84a28e2546e093c84808eeb9a748, user_id=f8c275e2c7ec4e599734f4d1f568c738, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:43.962209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:43.979511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1011/2034] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:43 2022] PUT /identity/v3/projects/5c7a84a28e2546e093c84808eeb9a748/users/f8c275e2c7ec4e599734f4d1f568c738/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:44.006450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:44.012241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:44.070953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:44.072599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:44.086562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1024/2035] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:44.091110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:44.097660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5933-19ee-4fa7-a921-62293be5d15d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:44.109481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599552d-f62d-4be9-8424-2987360992d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:44.110549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599552d-f62d-4be9-8424-2987360992d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.111045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599552d-f62d-4be9-8424-2987360992d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.111524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599552d-f62d-4be9-8424-2987360992d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.112804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599552d-f62d-4be9-8424-2987360992d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:44.114872 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599552d-f62d-4be9-8424-2987360992d0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:44.134427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1012/2036] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:44.136341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:44.158452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9a35d-6897-4f15-abb1-7ee24d42cf17 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:44.172425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:44.173291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.173647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.174050 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] PATH_INFO: `/v3/projects/5c7a84a28e2546e093c84808eeb9a748/users/f8c275e2c7ec4e599734f4d1f568c738/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.177977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7a84a28e2546e093c84808eeb9a748, user_id=f8c275e2c7ec4e599734f4d1f568c738, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:44.180767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:44.201591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1025/2037] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:44 2022] PUT /identity/v3/projects/5c7a84a28e2546e093c84808eeb9a748/users/f8c275e2c7ec4e599734f4d1f568c738/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:44.211680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.211974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.212255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.247066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] MFA Rules not processed for user `f8c275e2c7ec4e599734f4d1f568c738`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:44.248477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:44.349078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1013/2038] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:44.360137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:44.362583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:44.462662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6607a-284f-4cc8-9942-ddfa82cf708a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:44.466251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:44.466934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.467230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.467510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.546292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:44.547769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:44.560936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1026/2039] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:44.590664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:44.592115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:44.702060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:44.703579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:44.729235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658a33a-5a2e-46e5-be30-914eb73d2eb4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:44.734576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:44.735315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.735661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.736004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] PATH_INFO: `/v3/users/37d71dcd8b5c4eee947a517b362d156d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.737244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d71dcd8b5c4eee947a517b362d156d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:44.739435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:44.805424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d71dcd8b5c4eee947a517b362d156d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.814918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708929b6-305e-49f3-bff3-0a1b1ec382a7 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:44.816443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d71dcd8b5c4eee947a517b362d156d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.817267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d71dcd8b5c4eee947a517b362d156d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.821352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:44.835743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.836017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.836287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] PATH_INFO: `/v3/users/e1a09994c5b647ab9d40a158fee62f1d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.837864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a09994c5b647ab9d40a158fee62f1d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:44.840822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:44.856198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d71dcd8b5c4eee947a517b362d156d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.857154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:44.862965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:44.871836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-fd76bbaa-26da-41c8-a874-96b5980294bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d71dcd8b5c4eee947a517b362d156d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.882697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1014/2040] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:44 2022] DELETE /identity/v3/users/37d71dcd8b5c4eee947a517b362d156d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:44.889279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:44.889902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:44.890336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:44.931874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a09994c5b647ab9d40a158fee62f1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.938902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:44.940382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:44.953287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a09994c5b647ab9d40a158fee62f1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.988329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a09994c5b647ab9d40a158fee62f1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:44.989255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a09994c5b647ab9d40a158fee62f1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.003046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a09994c5b647ab9d40a158fee62f1d'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.014393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1027/2041] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:44 2022] DELETE /identity/v3/users/e1a09994c5b647ab9d40a158fee62f1d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:45.089175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1015/2042] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:45.110011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.112230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:45.219538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09f9d6-f3c2-4371-a752-393a7215aa6c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.224061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378bdbb-5215-4dab-8468-a64991a2d18b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.224938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378bdbb-5215-4dab-8468-a64991a2d18b service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.225162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378bdbb-5215-4dab-8468-a64991a2d18b service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.225495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378bdbb-5215-4dab-8468-a64991a2d18b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.297438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378bdbb-5215-4dab-8468-a64991a2d18b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.299823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378bdbb-5215-4dab-8468-a64991a2d18b service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.312681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1028/2043] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:45.329567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.331158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:45.343558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e27cb-bae1-45af-8a82-1d7cbb9c2383 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.354820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.355647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.356075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.356207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] PATH_INFO: `/v3/projects/52cc55c0d0e54259b75fc1bbecf809f4` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.357831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cc55c0d0e54259b75fc1bbecf809f4)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.359826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.410622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cc55c0d0e54259b75fc1bbecf809f4', 'request_id': 'req-3f83cb50-00c3-4079-94bd-ac95982c380a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.419264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cc55c0d0e54259b75fc1bbecf809f4', 'request_id': 'req-3f83cb50-00c3-4079-94bd-ac95982c380a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.426434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cc55c0d0e54259b75fc1bbecf809f4', 'request_id': 'req-3f83cb50-00c3-4079-94bd-ac95982c380a'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.437914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] The token cache is being invalidate because project 52cc55c0d0e54259b75fc1bbecf809f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:45.438453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.439183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f83cb50-00c3-4079-94bd-ac95982c380a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.440989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1016/2044] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:45 2022] DELETE /identity/v3/projects/52cc55c0d0e54259b75fc1bbecf809f4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:45.446123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4185-ef38-4e78-93de-13423c91d222 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.446554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4185-ef38-4e78-93de-13423c91d222 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.446893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa4185-ef38-4e78-93de-13423c91d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.468229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-17fa4185-ef38-4e78-93de-13423c91d222 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:45.469458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-17fa4185-ef38-4e78-93de-13423c91d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:45.511578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:45.545852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1029/2045] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:45.554837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73312c69-0503-433d-a8e7-6a819147330c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.555121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73312c69-0503-433d-a8e7-6a819147330c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.555410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73312c69-0503-433d-a8e7-6a819147330c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.586557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-73312c69-0503-433d-a8e7-6a819147330c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:45.587869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-73312c69-0503-433d-a8e7-6a819147330c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:45.595939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1017/2046] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:45.600411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa4185-ef38-4e78-93de-13423c91d222 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.611478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa4185-ef38-4e78-93de-13423c91d222 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.616531 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.617303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.617585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.617862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.618710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:45.619369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.621037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.634116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1030/2047] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:45.637946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73312c69-0503-433d-a8e7-6a819147330c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.647600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73312c69-0503-433d-a8e7-6a819147330c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.652865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.653496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.653805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.654115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.654792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.656789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.690594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.692456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:45.696224 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1018/2048] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:45 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:45.710751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cae45-3a8d-46c6-b8c7-2fe1af3f413f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.715275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.770366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:45.772113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.773015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.773246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.773524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] PATH_INFO: `/v3/projects/388feeca8634404898d26db9b832f308` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.774888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=388feeca8634404898d26db9b832f308)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.777447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.783790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36feb4e4-68d7-4804-825c-c76a1e86c96b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.789810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.790715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.791075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.791434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.792158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.794190 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.817962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1019/2049] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:45 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:45.820934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.826650 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388feeca8634404898d26db9b832f308', 'request_id': 'req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.831330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8add0b-bea2-4cfa-9027-37745680f2b7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.834177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388feeca8634404898d26db9b832f308', 'request_id': 'req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.840860 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388feeca8634404898d26db9b832f308', 'request_id': 'req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.852398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] The token cache is being invalidate because project 388feeca8634404898d26db9b832f308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:45.852715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.853379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.854960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1031/2050] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:45 2022] DELETE /identity/v3/projects/388feeca8634404898d26db9b832f308 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:45.859001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.860411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:45.890134 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.890778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.891060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.891330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.892030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.893661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.903774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1020/2051] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:45.907494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.909188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:45.921138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f59fba-361b-4d64-b4c3-38aa04f547e7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.923914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:45.926665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.927281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.927563 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.927843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.927981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ec9b-5520-432b-84e6-8ad13e00d4ec admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.928607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.930564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.933922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.934681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.935126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.935559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] PATH_INFO: `/v3/users/12a1646b8bcc47978ec3ff7b5279fe2e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.936978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a1646b8bcc47978ec3ff7b5279fe2e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.939059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.942324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1021/2052] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:45.946313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:45.955903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859037de-6a58-4607-bdeb-991ad0f65836 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:45.960719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6949f-c31e-4ce7-b47a-0a399bb5686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:45.961433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6949f-c31e-4ce7-b47a-0a399bb5686a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:45.961779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6949f-c31e-4ce7-b47a-0a399bb5686a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:45.962139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6949f-c31e-4ce7-b47a-0a399bb5686a admin admin] PATH_INFO: `/v3/projects/26661aa682ec4574ae5879fa2e120253/users/59e0b75ebfd64c5fa2a4dd012c6620be/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:45.979861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6949f-c31e-4ce7-b47a-0a399bb5686a admin admin] RBAC: Authorizing `identity:create_grant(project_id=26661aa682ec4574ae5879fa2e120253, user_id=59e0b75ebfd64c5fa2a4dd012c6620be, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:45.983004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6949f-c31e-4ce7-b47a-0a399bb5686a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:45.989581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a1646b8bcc47978ec3ff7b5279fe2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.998704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a1646b8bcc47978ec3ff7b5279fe2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:45.998889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1022/2053] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:45 2022] PUT /identity/v3/projects/26661aa682ec4574ae5879fa2e120253/users/59e0b75ebfd64c5fa2a4dd012c6620be/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:46.003782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.004070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.004370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.011859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a1646b8bcc47978ec3ff7b5279fe2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.012654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a1646b8bcc47978ec3ff7b5279fe2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.020076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a1646b8bcc47978ec3ff7b5279fe2e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.022778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:46.023913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.026278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1032/2054] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:45 2022] DELETE /identity/v3/users/12a1646b8bcc47978ec3ff7b5279fe2e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:46.103654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1023/2055] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:46.113585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.115236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.127313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.129328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.142390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d027d7d-e31b-4b15-aaa9-70ac5bf80441 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.147673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.148420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.148774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.149112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] PATH_INFO: `/v3/users/908f50359bd744b7b6ae3a1b2db36459` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.150870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] RBAC: Authorizing `identity:delete_user(user_id=908f50359bd744b7b6ae3a1b2db36459)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.152368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.191782 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ba539-550f-4a60-84f8-b2821de32693 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.200267 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea65b-f9a1-4545-a440-b981dce91926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.209415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea65b-f9a1-4545-a440-b981dce91926 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.209800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea65b-f9a1-4545-a440-b981dce91926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.210232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea65b-f9a1-4545-a440-b981dce91926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.223927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea65b-f9a1-4545-a440-b981dce91926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.226454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea65b-f9a1-4545-a440-b981dce91926 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.230106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:46.245317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908f50359bd744b7b6ae3a1b2db36459'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.252904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1033/2056] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:46.276402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908f50359bd744b7b6ae3a1b2db36459'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.278439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908f50359bd744b7b6ae3a1b2db36459'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.300332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908f50359bd744b7b6ae3a1b2db36459'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.309209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908f50359bd744b7b6ae3a1b2db36459'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.316897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1024/2057] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:46 2022] DELETE /identity/v3/users/908f50359bd744b7b6ae3a1b2db36459 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:46.321873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.322209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.322488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.362282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:46.363581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.371740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.373278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.460069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1034/2058] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:46.470599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4a0b5-df1f-4ebf-914a-02c9de80148c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.470798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.473759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.490315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.491026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.491305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.492331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] PATH_INFO: `/v3/projects/5579bc1b484945bca8f6199e33ab6c14` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.493498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5579bc1b484945bca8f6199e33ab6c14)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.496183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.514681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:46.559374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5579bc1b484945bca8f6199e33ab6c14', 'request_id': 'req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.570679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5579bc1b484945bca8f6199e33ab6c14', 'request_id': 'req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.574591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322164a-5d7b-46e6-9e8a-e1bfeb5b7c65 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.585405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5579bc1b484945bca8f6199e33ab6c14', 'request_id': 'req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.599777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] The token cache is being invalidate because project 5579bc1b484945bca8f6199e33ab6c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:46.600153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.601003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ccf6ad82-b853-43f9-8ce5-b126363e7b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:46.603357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1025/2059] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:46 2022] DELETE /identity/v3/projects/5579bc1b484945bca8f6199e33ab6c14 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:46.608043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451c3fe-0c8b-4602-a95d-850207200a52 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.608333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451c3fe-0c8b-4602-a95d-850207200a52 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.608610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451c3fe-0c8b-4602-a95d-850207200a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.630261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7451c3fe-0c8b-4602-a95d-850207200a52 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:46.631613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7451c3fe-0c8b-4602-a95d-850207200a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.639885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.641306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.641760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.642479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.644521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.684949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:46.711382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1026/2060] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:46.719380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afab0-41cc-4243-97d4-72bc1efe0adb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.720256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afab0-41cc-4243-97d4-72bc1efe0adb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.720543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7afab0-41cc-4243-97d4-72bc1efe0adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.740984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd7afab0-41cc-4243-97d4-72bc1efe0adb None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:46.742340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd7afab0-41cc-4243-97d4-72bc1efe0adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:46.745345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.747513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.751766 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1027/2061] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:46.755700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7afab0-41cc-4243-97d4-72bc1efe0adb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.759278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1035/2062] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:21:46.768346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7afab0-41cc-4243-97d4-72bc1efe0adb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.773980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.774747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.775112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.775444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.776272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:46.776640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.778512 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.795581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1028/2063] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:21:46.797018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.809430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829fb30-e223-498c-87af-96d124f916c1 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.815399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.816045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.816326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.816602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.817295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:46.820246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:46.858210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:46.858681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1036/2064] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:46 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:46.871378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e972fc-20f5-495c-ae7e-835710fc443d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:46.997682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:46.998363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:46.998923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:46.998923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:46.999579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.001588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.031905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1029/2065] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:46 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:47.035679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.047353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f06735-1013-4ac8-9ef8-987feeb72c51 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.052834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.053793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.053793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.054108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.054796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.057222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.069969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1037/2066] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:47.074390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.086176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cd1a9-6eef-40f8-bb1c-a5ba938ec9d4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.088995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.091292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:47.094829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.095484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.095935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.096222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.097031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.099554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.113984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1030/2067] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:21:47.118073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74183-1af1-441d-a496-012b3679ca4e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.118318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.126796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.127819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.128189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.128639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] PATH_INFO: `/v3/projects/5d6184efbb964246abe8071c33f46f00` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.130111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6184efbb964246abe8071c33f46f00)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.130889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f29a2e-7d0f-4251-a664-44749e9ca8aa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.132667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.137317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e254096-f120-40ef-a2a1-545d589f0b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.137708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254096-f120-40ef-a2a1-545d589f0b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.138159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254096-f120-40ef-a2a1-545d589f0b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.138306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e254096-f120-40ef-a2a1-545d589f0b9f admin admin] PATH_INFO: `/v3/projects/7fed3024a7654c13b57c0ed2ee372b28/users/ae3d02c6e61943d0be5a6375779ac330/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.158903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e254096-f120-40ef-a2a1-545d589f0b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fed3024a7654c13b57c0ed2ee372b28, user_id=ae3d02c6e61943d0be5a6375779ac330, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.165136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e254096-f120-40ef-a2a1-545d589f0b9f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.183518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1031/2068] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:47 2022] PUT /identity/v3/projects/7fed3024a7654c13b57c0ed2ee372b28/users/ae3d02c6e61943d0be5a6375779ac330/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:47.194698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:47.195304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.195667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.195988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.196088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6184efbb964246abe8071c33f46f00', 'request_id': 'req-6f145f9e-ab17-48c0-9cc1-c96fcc052691'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.207310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6184efbb964246abe8071c33f46f00', 'request_id': 'req-6f145f9e-ab17-48c0-9cc1-c96fcc052691'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.215198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6184efbb964246abe8071c33f46f00', 'request_id': 'req-6f145f9e-ab17-48c0-9cc1-c96fcc052691'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.232124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] The token cache is being invalidate because project 5d6184efbb964246abe8071c33f46f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:47.232755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.233385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] MFA Rules not processed for user `ae3d02c6e61943d0be5a6375779ac330`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:47.233907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.234787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:47.236426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1038/2069] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:47 2022] DELETE /identity/v3/projects/5d6184efbb964246abe8071c33f46f00 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:47.243030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.246758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:47.337312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1032/2070] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:47.349838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.351261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:47.356974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145f9e-ab17-48c0-9cc1-c96fcc052691 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.364687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.366180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.366747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.368489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] PATH_INFO: `/v3/users/c1a0e2ee9a2343dcada6766e46302f81` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.371244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a0e2ee9a2343dcada6766e46302f81)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.374113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.377429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:47.434645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb176a0-cac5-4706-8e3b-22390bfaf102 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.437148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a0e2ee9a2343dcada6766e46302f81'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.439494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.440339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.441088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.441366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.448217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a0e2ee9a2343dcada6766e46302f81'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.459074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.460625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.472916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1033/2071] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:47.477373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a0e2ee9a2343dcada6766e46302f81'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.478155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a0e2ee9a2343dcada6766e46302f81'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.510160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.513506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a0e2ee9a2343dcada6766e46302f81'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.514797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:47.533294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d3fd9-a43b-4954-916c-98a300fd25e3 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.546234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1039/2072] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:47 2022] DELETE /identity/v3/users/c1a0e2ee9a2343dcada6766e46302f81 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:47.568925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:47.571590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:47.608548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.609148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.609431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.609714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] PATH_INFO: `/v3/users/ae3d02c6e61943d0be5a6375779ac330` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.611029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3d02c6e61943d0be5a6375779ac330)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.613139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.712174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3d02c6e61943d0be5a6375779ac330'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.732077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:47.737379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49afcdc-2e37-485e-99bc-7a52025b5150 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:47.741819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3d02c6e61943d0be5a6375779ac330'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.742730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3d02c6e61943d0be5a6375779ac330'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.746194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:47.748419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.750168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.750558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] PATH_INFO: `/v3/users/c6b4a7ada1894458a0b7ffa1d93044f1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.752547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b4a7ada1894458a0b7ffa1d93044f1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:47.755183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:47.763393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3d02c6e61943d0be5a6375779ac330'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.774329 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-315575f2-5d71-45ef-870f-4999c0bec1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3d02c6e61943d0be5a6375779ac330'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.787029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1034/2073] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:47 2022] DELETE /identity/v3/users/ae3d02c6e61943d0be5a6375779ac330 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:47.788884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.789268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.790360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.834595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:47.838189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:47.867862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b4a7ada1894458a0b7ffa1d93044f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.891226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b4a7ada1894458a0b7ffa1d93044f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.903680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:47.919613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b4a7ada1894458a0b7ffa1d93044f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.924780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b4a7ada1894458a0b7ffa1d93044f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.947314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3eebbdef-1750-48ff-8c4c-65462cf89342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b4a7ada1894458a0b7ffa1d93044f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:47.956278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1040/2074] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:47 2022] DELETE /identity/v3/users/c6b4a7ada1894458a0b7ffa1d93044f1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:47.964662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:47.965153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:47.966202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:47.985914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1035/2075] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:48.002058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:48.004438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.125281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.127069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.142270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1041/2076] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:48.166367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.169045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.241227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4887c1-c509-4e6a-871a-b87158c11004 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:48.277357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1683250-39c4-4586-9d7f-e55e4a05b4ef None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:48.282710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:48.284354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.284848 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.285759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.312090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:48.315082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:48.327528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1042/2077] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:48.331063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.331256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7519639d-7689-44e0-a292-0c71ea7edd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:48.332306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519639d-7689-44e0-a292-0c71ea7edd7e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.332711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519639d-7689-44e0-a292-0c71ea7edd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.333192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7519639d-7689-44e0-a292-0c71ea7edd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.333608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.346186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519639d-7689-44e0-a292-0c71ea7edd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:48.348268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d4a71-eb9b-45dd-8d6b-f71bed4030fb service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:48.349513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7519639d-7689-44e0-a292-0c71ea7edd7e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:48.355855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:48.357037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.357501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.357990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] PATH_INFO: `/v3/projects/7b4c1d96c0234aa5b70b45e31c67cac6` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.360005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4c1d96c0234aa5b70b45e31c67cac6)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:48.362884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:48.399077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:48.402302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1036/2078] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:48.461744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4c1d96c0234aa5b70b45e31c67cac6', 'request_id': 'req-66707652-d763-485a-8afb-dfb783e5bf6f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.474803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4c1d96c0234aa5b70b45e31c67cac6', 'request_id': 'req-66707652-d763-485a-8afb-dfb783e5bf6f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.485856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4c1d96c0234aa5b70b45e31c67cac6', 'request_id': 'req-66707652-d763-485a-8afb-dfb783e5bf6f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.516465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] The token cache is being invalidate because project 7b4c1d96c0234aa5b70b45e31c67cac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:48.516841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.517468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66707652-d763-485a-8afb-dfb783e5bf6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.519460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1043/2079] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:48 2022] DELETE /identity/v3/projects/7b4c1d96c0234aa5b70b45e31c67cac6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:48.524907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802fcb-0fad-4b95-998d-3c0c82b7f26a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.525148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802fcb-0fad-4b95-998d-3c0c82b7f26a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.525544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802fcb-0fad-4b95-998d-3c0c82b7f26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.560393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c1802fcb-0fad-4b95-998d-3c0c82b7f26a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:48.562359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c1802fcb-0fad-4b95-998d-3c0c82b7f26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.670620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1037/2080] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:48.680345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.680730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.681102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.702271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:48.703518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.716517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1044/2081] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:48.719126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1802fcb-0fad-4b95-998d-3c0c82b7f26a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.754433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1802fcb-0fad-4b95-998d-3c0c82b7f26a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:48.764258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:48.764916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.765196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.765465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.766308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:48.766689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:48.768234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:48.784126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.785710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:48.789602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1038/2082] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:48.791039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.804616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21af35e-d1fa-414a-b45c-0421d6fb2639 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:48.812022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:48.813336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccea9bd-c13b-482e-99fc-070d995f2aa2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:48.813679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.814041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.814406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.815208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:48.817861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:48.820140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:48.820992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:48.821487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:48.822324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] PATH_INFO: `/v3/projects/466c5fcf6fca494ab4a80a8cce2306a2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:48.823400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=466c5fcf6fca494ab4a80a8cce2306a2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:48.827102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:48.849647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:48.886072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1039/2083] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:48 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:48.888890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.889676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466c5fcf6fca494ab4a80a8cce2306a2', 'request_id': 'req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.909842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466c5fcf6fca494ab4a80a8cce2306a2', 'request_id': 'req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.919472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466c5fcf6fca494ab4a80a8cce2306a2', 'request_id': 'req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.942498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] The token cache is being invalidate because project 466c5fcf6fca494ab4a80a8cce2306a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:48.942937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.945443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:48.949016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1045/2084] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:48 2022] DELETE /identity/v3/projects/466c5fcf6fca494ab4a80a8cce2306a2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:48.953153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:48.957984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.039078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf4752-afcd-494c-b6c7-ab4800fe40c6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.045273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.046531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.046807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.047082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.048177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.052354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.078583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee58e7-07b0-47ea-bed8-f76a36ce2536 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.084371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1040/2085] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:48 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:49.088321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.090167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.091735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.092480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.092828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.093168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] PATH_INFO: `/v3/users/f8c275e2c7ec4e599734f4d1f568c738` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.097911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c275e2c7ec4e599734f4d1f568c738)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.100296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.104799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c16d75-8d34-49bd-a59e-b0e24fbca4a2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.115009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.116666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.119420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.125487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.128168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.130841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.147862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:49.174699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1041/2086] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:49.176451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.179891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.205849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ca24-c041-47fc-b3ee-52a3722bf183 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.213698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.214485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.214841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.215189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] PATH_INFO: `/v3/projects/7fed3024a7654c13b57c0ed2ee372b28` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.216850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fed3024a7654c13b57c0ed2ee372b28)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.217989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c275e2c7ec4e599734f4d1f568c738'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.220824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.248797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c275e2c7ec4e599734f4d1f568c738'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.285526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c275e2c7ec4e599734f4d1f568c738'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.290921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c275e2c7ec4e599734f4d1f568c738'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.321968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c275e2c7ec4e599734f4d1f568c738'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.348743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1046/2087] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:48 2022] DELETE /identity/v3/users/f8c275e2c7ec4e599734f4d1f568c738 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:49.353086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fed3024a7654c13b57c0ed2ee372b28', 'request_id': 'req-33fdce06-0612-4c12-b835-557bd7fe6996'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.358104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.362321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.364914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fed3024a7654c13b57c0ed2ee372b28', 'request_id': 'req-33fdce06-0612-4c12-b835-557bd7fe6996'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.376699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fed3024a7654c13b57c0ed2ee372b28', 'request_id': 'req-33fdce06-0612-4c12-b835-557bd7fe6996'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.398222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] The token cache is being invalidate because project 7fed3024a7654c13b57c0ed2ee372b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:49.399760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.401101 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33fdce06-0612-4c12-b835-557bd7fe6996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:49.403366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1042/2088] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:49 2022] DELETE /identity/v3/projects/7fed3024a7654c13b57c0ed2ee372b28 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:49.425506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca5226-805b-46fc-a69e-e07c7d16037a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.426779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca5226-805b-46fc-a69e-e07c7d16037a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.427295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca5226-805b-46fc-a69e-e07c7d16037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.478124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7cca5226-805b-46fc-a69e-e07c7d16037a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:49.479820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7cca5226-805b-46fc-a69e-e07c7d16037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.553887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67f39-7f01-402c-a521-0361d92a84ec admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.563265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.563919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.564188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.564455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.565165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.566819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.594101 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1047/2089] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:49.595448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.598417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.607348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:49.633345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1043/2090] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:49.635698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f2049-c7c0-42e8-9e43-03166a47e8e0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.635985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f2049-c7c0-42e8-9e43-03166a47e8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.636310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f2049-c7c0-42e8-9e43-03166a47e8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.648096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506a3c2-0628-4f67-a2cf-07a087e5213c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.656828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533a684-eb03-4759-aa05-eed77095607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.657533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533a684-eb03-4759-aa05-eed77095607f admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.657813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533a684-eb03-4759-aa05-eed77095607f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.658135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533a684-eb03-4759-aa05-eed77095607f admin admin] PATH_INFO: `/v3/projects/51e933bc2f43409897bbb7cfef97e215/users/896a55e9658a4950a50caf7b4e28ed17/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.670375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-676f2049-c7c0-42e8-9e43-03166a47e8e0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:49.672723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-676f2049-c7c0-42e8-9e43-03166a47e8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.685991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1044/2091] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:49.691303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f2049-c7c0-42e8-9e43-03166a47e8e0 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.693459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533a684-eb03-4759-aa05-eed77095607f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e933bc2f43409897bbb7cfef97e215, user_id=896a55e9658a4950a50caf7b4e28ed17, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.701567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533a684-eb03-4759-aa05-eed77095607f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.706211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f2049-c7c0-42e8-9e43-03166a47e8e0 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.715086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.715767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.716229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.716627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.717403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:49.717836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.720776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.743528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1045/2092] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:49.749584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1048/2093] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:49 2022] PUT /identity/v3/projects/51e933bc2f43409897bbb7cfef97e215/users/896a55e9658a4950a50caf7b4e28ed17/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:49.751029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.777377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db834-268b-417d-bc72-b972076fdad5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.777763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db834-268b-417d-bc72-b972076fdad5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.777969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66db834-268b-417d-bc72-b972076fdad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.778717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03a04-4ec3-41c8-9280-2de033597498 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:49.860788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c66db834-268b-417d-bc72-b972076fdad5 None None] MFA Rules not processed for user `896a55e9658a4950a50caf7b4e28ed17`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:49.862233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c66db834-268b-417d-bc72-b972076fdad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:49.931267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:49.931910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:49.932191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:49.932470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:49.933792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:49.935359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:49.965041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:49.984446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1049/2094] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:49.985391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66db834-268b-417d-bc72-b972076fdad5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:49.993669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1046/2095] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:49 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:49.998656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.012925 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66db834-268b-417d-bc72-b972076fdad5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.131117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.132038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.132477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.132844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.133731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.137442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.152555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43063a6c-2713-4c02-866b-543e956c336b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.159464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.160147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.160543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.160923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.161661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.164137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.185138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1050/2096] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:49 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:50.189857 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.202238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1047/2097] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:49 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:50.203042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.216226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be9415-7fd7-4485-8085-bfa4d16965df admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.288458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1939a43-b3da-4c85-aa81-b040caa5f741 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.299539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:50.302174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.302866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.303241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.303517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.304246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.308034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.324400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.325135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.325504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.326085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.326965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.328678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.344595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1051/2098] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:50 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:50.345580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.346443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1048/2099] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:50.347344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.348213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:50.358289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d098f8-850e-497d-9176-a0f7bafad78c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.361862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef92fb5-d4c7-4cca-b5ad-6b6904410ed2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.363674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.364305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.364652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.364937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.365667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.367137 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.367626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.367778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.368076 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.368349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] PATH_INFO: `/v3/projects/5c7a84a28e2546e093c84808eeb9a748` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.370608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7a84a28e2546e093c84808eeb9a748)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.375995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.380148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1049/2100] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:50.380970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.393465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd3f8e-885e-4f48-b9af-87f2cef149f4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.399828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.400577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.400852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.401124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.402138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.403548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.419513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1050/2101] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:50.420521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.434237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7a84a28e2546e093c84808eeb9a748', 'request_id': 'req-3c858bae-edf6-4893-846b-351c071ad8f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:50.435394 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b84d1-3b09-4642-b59c-aa43dbe6543e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.445580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7a84a28e2546e093c84808eeb9a748', 'request_id': 'req-3c858bae-edf6-4893-846b-351c071ad8f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:50.453385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7a84a28e2546e093c84808eeb9a748', 'request_id': 'req-3c858bae-edf6-4893-846b-351c071ad8f3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:50.456743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:50.470168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] The token cache is being invalidate because project 5c7a84a28e2546e093c84808eeb9a748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:50.471567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:50.473317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:50.489960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1052/2102] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:50 2022] DELETE /identity/v3/projects/5c7a84a28e2546e093c84808eeb9a748 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:50.489960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.489960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:50.605388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.608292 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.609162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.610290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] PATH_INFO: `/v3/projects/e42cfa4574ce4f8f824d972afef54646/users/8cc6fa09f2664cd3aeb2bd03c598b06a/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.659068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42cfa4574ce4f8f824d972afef54646, user_id=8cc6fa09f2664cd3aeb2bd03c598b06a, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.661510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858bae-edf6-4893-846b-351c071ad8f3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.663611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.667104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26154751-824b-4023-a090-f366e5550765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.668127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154751-824b-4023-a090-f366e5550765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.668524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154751-824b-4023-a090-f366e5550765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.668895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26154751-824b-4023-a090-f366e5550765 admin admin] PATH_INFO: `/v3/projects/7fdf462c88974a94a274bc936d0e66fb/users/56bd15dbd98c4769a13e2c61ca6279fc/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.703815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1051/2103] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:50 2022] PUT /identity/v3/projects/e42cfa4574ce4f8f824d972afef54646/users/8cc6fa09f2664cd3aeb2bd03c598b06a/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:50.703815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.706554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:50.719603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154751-824b-4023-a090-f366e5550765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdf462c88974a94a274bc936d0e66fb, user_id=56bd15dbd98c4769a13e2c61ca6279fc, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.724343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26154751-824b-4023-a090-f366e5550765 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:50.753681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1053/2104] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:50 2022] PUT /identity/v3/projects/7fdf462c88974a94a274bc936d0e66fb/users/56bd15dbd98c4769a13e2c61ca6279fc/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:50.764211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.764505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.764782 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.813363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] MFA Rules not processed for user `56bd15dbd98c4769a13e2c61ca6279fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:50.814482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:50.832023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9727402-fcc0-4af5-8f67-1e9b25b6d2ed admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:50.942680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:50.952272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1054/2105] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:50.954783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:50.955437 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:50.955718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:50.955990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:50.971105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:50.972034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:50.973021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:50.975654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:51.009315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1052/2106] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:51.013688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:51.028294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ced59d-315a-4af2-8d77-813e47a2f2d8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:51.048016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60836697-291f-4774-a4d8-60f036afb181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:51.049147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836697-291f-4774-a4d8-60f036afb181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:51.049632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836697-291f-4774-a4d8-60f036afb181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:51.050092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60836697-291f-4774-a4d8-60f036afb181 admin admin] PATH_INFO: `/v3/projects/e42cfa4574ce4f8f824d972afef54646/users/8cc6fa09f2664cd3aeb2bd03c598b06a/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:51.052635 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836697-291f-4774-a4d8-60f036afb181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42cfa4574ce4f8f824d972afef54646, user_id=8cc6fa09f2664cd3aeb2bd03c598b06a, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:51.055627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60836697-291f-4774-a4d8-60f036afb181 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:51.067308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6b288-8909-4eb0-93f7-eb852472df08 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:51.068229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1053/2107] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:51 2022] PUT /identity/v3/projects/e42cfa4574ce4f8f824d972afef54646/users/8cc6fa09f2664cd3aeb2bd03c598b06a/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:51.078432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c177-1c14-4aac-bb6b-07d60385b6e3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:51.078952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c177-1c14-4aac-bb6b-07d60385b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:51.079356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3c177-1c14-4aac-bb6b-07d60385b6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:51.102790 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:51.151183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b4b3c177-1c14-4aac-bb6b-07d60385b6e3 None None] MFA Rules not processed for user `8cc6fa09f2664cd3aeb2bd03c598b06a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:51.153133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b4b3c177-1c14-4aac-bb6b-07d60385b6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:51.167890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:51.168563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:51.169022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:51.169304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:51.266672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:51.268406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:51.281094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1055/2108] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:51.305886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1054/2109] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:51.316982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:51.318447 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:51.331880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30f5b0-6ef2-43d9-bea3-ac3538603923 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:51.336639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:51.337320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:51.337600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:51.337870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:51.340008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:51.419976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:51.421477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:51.444100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1056/2110] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:52.876657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f38de-a662-4354-a547-7495f054878d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:52.877155 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f38de-a662-4354-a547-7495f054878d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:52.877257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f38de-a662-4354-a547-7495f054878d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:52.937625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e35f38de-a662-4354-a547-7495f054878d None None] MFA Rules not processed for user `59e0b75ebfd64c5fa2a4dd012c6620be`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:52.939508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e35f38de-a662-4354-a547-7495f054878d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:53.060891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1055/2111] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:53.077472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:53.079122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:53.194427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2db01-8e4a-47e9-b1d8-8f1f42dc1593 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:53.203205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8dc73-3862-43a3-bfb8-edfcf57b6381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:53.204033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8dc73-3862-43a3-bfb8-edfcf57b6381 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:53.204837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8dc73-3862-43a3-bfb8-edfcf57b6381 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:53.204837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8dc73-3862-43a3-bfb8-edfcf57b6381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:53.225574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8dc73-3862-43a3-bfb8-edfcf57b6381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:53.228002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8dc73-3862-43a3-bfb8-edfcf57b6381 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:53.240166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1057/2112] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:54.074068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f38de-a662-4354-a547-7495f054878d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:54.138481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:54.144337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f38de-a662-4354-a547-7495f054878d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:54.150167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:54.150840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.151117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.151389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] PATH_INFO: `/v3/users/56bd15dbd98c4769a13e2c61ca6279fc` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.152574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56bd15dbd98c4769a13e2c61ca6279fc)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:54.154575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:54.205747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56bd15dbd98c4769a13e2c61ca6279fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:54.214088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56bd15dbd98c4769a13e2c61ca6279fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:54.214856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56bd15dbd98c4769a13e2c61ca6279fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:54.228906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56bd15dbd98c4769a13e2c61ca6279fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:54.237348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56bd15dbd98c4769a13e2c61ca6279fc'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:54.243485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1056/2113] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:21:54 2022] DELETE /identity/v3/users/56bd15dbd98c4769a13e2c61ca6279fc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:54.248487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.248981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.249263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.256661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:54.270126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:54.271450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:54.338722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1058/2114] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:54.346932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:54.348780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:54.428241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36bf15-3bf0-4b75-a1d1-88a27d0d3e72 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:54.433388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031eb684-2426-43e9-88c0-5cd7013280d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:54.434070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb684-2426-43e9-88c0-5cd7013280d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.434367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb684-2426-43e9-88c0-5cd7013280d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.434639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031eb684-2426-43e9-88c0-5cd7013280d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.447043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eb684-2426-43e9-88c0-5cd7013280d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:54.448525 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031eb684-2426-43e9-88c0-5cd7013280d7 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:54.460493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1057/2115] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:54.845065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:54.846933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:54.876160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a1e40-80a4-4d88-aa98-94b36be99bfe None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:54.886551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:54.887342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:54.887723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:54.888277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] PATH_INFO: `/v3/projects/7fdf462c88974a94a274bc936d0e66fb` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:54.891581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdf462c88974a94a274bc936d0e66fb)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:54.897229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:54.981923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdf462c88974a94a274bc936d0e66fb', 'request_id': 'req-66409f8b-5007-435d-b1ed-d85ee139df78'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:55.007346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdf462c88974a94a274bc936d0e66fb', 'request_id': 'req-66409f8b-5007-435d-b1ed-d85ee139df78'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:55.010405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdf462c88974a94a274bc936d0e66fb', 'request_id': 'req-66409f8b-5007-435d-b1ed-d85ee139df78'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:55.050220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] The token cache is being invalidate because project 7fdf462c88974a94a274bc936d0e66fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:21:55.050220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:55.055011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-66409f8b-5007-435d-b1ed-d85ee139df78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:21:55.060920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1059/2116] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:21:54 2022] DELETE /identity/v3/projects/7fdf462c88974a94a274bc936d0e66fb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:21:55.065689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab70a-3bd8-48df-b36a-72cac82fe9b9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.066126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab70a-3bd8-48df-b36a-72cac82fe9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.066356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ab70a-3bd8-48df-b36a-72cac82fe9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.143804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-194ab70a-3bd8-48df-b36a-72cac82fe9b9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:55.148299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-194ab70a-3bd8-48df-b36a-72cac82fe9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:55.264023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd62ce-ed29-4ce6-817d-94507a0e0591 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.264898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd62ce-ed29-4ce6-817d-94507a0e0591 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.265232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd62ce-ed29-4ce6-817d-94507a0e0591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.295159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fbbd62ce-ed29-4ce6-817d-94507a0e0591 None None] MFA Rules not processed for user `59e0b75ebfd64c5fa2a4dd012c6620be`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:55.297959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fbbd62ce-ed29-4ce6-817d-94507a0e0591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:55.311713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1058/2117] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:55.321055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613c6f6-82e4-436a-9a34-5f2ab7d1e633 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.321495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613c6f6-82e4-436a-9a34-5f2ab7d1e633 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.321736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613c6f6-82e4-436a-9a34-5f2ab7d1e633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.351863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3613c6f6-82e4-436a-9a34-5f2ab7d1e633 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:55.353074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3613c6f6-82e4-436a-9a34-5f2ab7d1e633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:55.366519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1059/2118] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:55.367726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613c6f6-82e4-436a-9a34-5f2ab7d1e633 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:55.380122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613c6f6-82e4-436a-9a34-5f2ab7d1e633 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:55.388523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:55.389209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.389560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.389889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.390703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:21:55.391010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:55.392636 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:55.401004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:55.410813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1060/2119] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:21:55.411852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:55.423524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18e570-6636-47e2-9309-6ff2923780b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:55.432999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:55.434261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.434991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.435649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.436591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:55.439258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:55.444865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1060/2120] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:55.471968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1061/2121] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:21:55 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:21:55.476058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd62ce-ed29-4ce6-817d-94507a0e0591 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:55.487036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd62ce-ed29-4ce6-817d-94507a0e0591 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:55.522371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:55.556159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:55.557148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.557536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.557921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.558944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:55.561347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:55.591983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1061/2122] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:21:55 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:21:55.593619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:55.604672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1a6a5-f530-49d3-b2f2-afd6b410a01f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:55.609172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:55.609798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.610153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.610667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.612113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:55.613045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:55.627647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1062/2123] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:55.628397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:55.640189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf9f5-3b02-42c1-bcaf-1c6fb55fabea admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:55.647826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10ccf9e-0fcf-4670-9626-bff56cf1f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:55.648576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ccf9e-0fcf-4670-9626-bff56cf1f416 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.648852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ccf9e-0fcf-4670-9626-bff56cf1f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.649130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ccf9e-0fcf-4670-9626-bff56cf1f416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.649846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ccf9e-0fcf-4670-9626-bff56cf1f416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:55.651731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10ccf9e-0fcf-4670-9626-bff56cf1f416 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:55.663392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1062/2124] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:21:55.667671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:55.678212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dfadf-32f9-407e-aad5-2d7910c53a5d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:55.682988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:55.683865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.684177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.684941 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] PATH_INFO: `/v3/projects/36b790b40cde43bcac1bd452968bbeee/users/0689cf10e21441568c7298885434eec0/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.702957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b790b40cde43bcac1bd452968bbeee, user_id=0689cf10e21441568c7298885434eec0, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:55.705874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:55.725298 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1063/2125] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:21:55 2022] PUT /identity/v3/projects/36b790b40cde43bcac1bd452968bbeee/users/0689cf10e21441568c7298885434eec0/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:21:55.726699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.727011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.727315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.749347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:55.750637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:55.826556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1063/2126] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:21:55.836438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:55.839700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:55.934995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3e61a-c5a3-49d5-8e11-9f5ff928007a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:55.940188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea7224-35e6-4205-bb94-0a801c7a6a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:55.940855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea7224-35e6-4205-bb94-0a801c7a6a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:55.941136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea7224-35e6-4205-bb94-0a801c7a6a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:55.941411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea7224-35e6-4205-bb94-0a801c7a6a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:55.951285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea7224-35e6-4205-bb94-0a801c7a6a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:55.952737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea7224-35e6-4205-bb94-0a801c7a6a07 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:55.964911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1064/2127] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:56.358892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:56.360592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:56.443915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff20541-ec42-439f-a544-890f81b1b680 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:56.469552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:56.470368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:56.471717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:56.472435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:56.479610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:56.653889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:56.655513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:56.662690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:21:56.670237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1064/2128] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:57.111706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1193b8-bac2-494e-a64f-0fb89c1f4836 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:57.112260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1193b8-bac2-494e-a64f-0fb89c1f4836 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:57.112541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1193b8-bac2-494e-a64f-0fb89c1f4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:57.151378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f1193b8-bac2-494e-a64f-0fb89c1f4836 None None] MFA Rules not processed for user `0689cf10e21441568c7298885434eec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:57.152666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f1193b8-bac2-494e-a64f-0fb89c1f4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:57.258358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1065/2129] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:21:57.271757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:21:57.282638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4bf5d-0382-4a6d-bfd9-82215a866c25 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:21:57.287638 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:21:57.288891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:57.289174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:57.289449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:57.300983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:21:57.302674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:21:57.315687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1065/2130] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:21:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:21:58.863782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6eab1-0574-4232-9d6b-ad84da427f0b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:21:58.864326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6eab1-0574-4232-9d6b-ad84da427f0b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:21:58.864326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6eab1-0574-4232-9d6b-ad84da427f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:21:58.896175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-3bf6eab1-0574-4232-9d6b-ad84da427f0b None None] MFA Rules not processed for user `0689cf10e21441568c7298885434eec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:21:58.897348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3bf6eab1-0574-4232-9d6b-ad84da427f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:21:58.910442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1066/2131] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:21:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:01.889787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:01.892081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:01.911777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e3ed0-3e16-4faf-9b1b-02b1769e2435 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:01.916863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:01.917656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:01.918086 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:01.918451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] PATH_INFO: `/v3/users/896a55e9658a4950a50caf7b4e28ed17` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:01.919846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] RBAC: Authorizing `identity:delete_user(user_id=896a55e9658a4950a50caf7b4e28ed17)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:01.922386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:01.989332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '896a55e9658a4950a50caf7b4e28ed17'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.001719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '896a55e9658a4950a50caf7b4e28ed17'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.017620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '896a55e9658a4950a50caf7b4e28ed17'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.019202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '896a55e9658a4950a50caf7b4e28ed17'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.026213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '896a55e9658a4950a50caf7b4e28ed17'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.032312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1066/2132] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:01 2022] DELETE /identity/v3/users/896a55e9658a4950a50caf7b4e28ed17 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:02.037246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.037748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.037829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.057016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:02.058241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:02.078503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:02.129838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1067/2133] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:02.138622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:02.142820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:02.238519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97448b-1893-451e-9e88-4a915767589e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:02.242527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:02.243196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.244001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.244313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.254500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:02.256095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:02.267102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1067/2134] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:02.669059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:02.670574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:02.684317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dedfe5-b03c-4ad2-ad7f-5c3e4b13f855 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:02.689725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:02.690657 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.691040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.691415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] PATH_INFO: `/v3/projects/51e933bc2f43409897bbb7cfef97e215` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.692736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e933bc2f43409897bbb7cfef97e215)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:02.695202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:02.755233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e933bc2f43409897bbb7cfef97e215', 'request_id': 'req-42eb3962-e321-4ac0-9ab6-b602290ced6d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.763079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e933bc2f43409897bbb7cfef97e215', 'request_id': 'req-42eb3962-e321-4ac0-9ab6-b602290ced6d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.770411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e933bc2f43409897bbb7cfef97e215', 'request_id': 'req-42eb3962-e321-4ac0-9ab6-b602290ced6d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.782061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] The token cache is being invalidate because project 51e933bc2f43409897bbb7cfef97e215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:02.782351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.783001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.785640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1068/2135] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:02 2022] DELETE /identity/v3/projects/51e933bc2f43409897bbb7cfef97e215 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:02.789275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:02.800169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa4cc8-e6b5-4389-b1f9-b24a97465a3a service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:02.856906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:02.857552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:02.857849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:02.858150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] PATH_INFO: `/v3/users/8cc6fa09f2664cd3aeb2bd03c598b06a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:02.859304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc6fa09f2664cd3aeb2bd03c598b06a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:02.861220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:02.865060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:02.919893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc6fa09f2664cd3aeb2bd03c598b06a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.928261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc6fa09f2664cd3aeb2bd03c598b06a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.942891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc6fa09f2664cd3aeb2bd03c598b06a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.943705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc6fa09f2664cd3aeb2bd03c598b06a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.951064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b20a728e-7c81-4ffc-a630-cfcb1e07bfc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc6fa09f2664cd3aeb2bd03c598b06a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:02.963393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1068/2136] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:02 2022] DELETE /identity/v3/users/8cc6fa09f2664cd3aeb2bd03c598b06a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:03.448849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:03.450434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:03.474424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3962-e321-4ac0-9ab6-b602290ced6d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:03.545906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:03.546879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.547267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.547688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] PATH_INFO: `/v3/projects/e42cfa4574ce4f8f824d972afef54646` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.548717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42cfa4574ce4f8f824d972afef54646)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:03.550842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:03.603566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42cfa4574ce4f8f824d972afef54646', 'request_id': 'req-d4392589-87a6-4000-a1f0-ed97eed5bba5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:03.609043 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:03.623620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42cfa4574ce4f8f824d972afef54646', 'request_id': 'req-d4392589-87a6-4000-a1f0-ed97eed5bba5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:03.636061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42cfa4574ce4f8f824d972afef54646', 'request_id': 'req-d4392589-87a6-4000-a1f0-ed97eed5bba5'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:03.649674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] The token cache is being invalidate because project e42cfa4574ce4f8f824d972afef54646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:03.649674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:03.653378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4392589-87a6-4000-a1f0-ed97eed5bba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:03.655390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1069/2137] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:03 2022] DELETE /identity/v3/projects/e42cfa4574ce4f8f824d972afef54646 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:03.663398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8de5-26c0-4775-a8cb-5384e6c8c4ec None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.663869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8de5-26c0-4775-a8cb-5384e6c8c4ec None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.665013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd8de5-26c0-4775-a8cb-5384e6c8c4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.691525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-85cd8de5-26c0-4775-a8cb-5384e6c8c4ec None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:03.692833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-85cd8de5-26c0-4775-a8cb-5384e6c8c4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:03.792807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1069/2138] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:03.800980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d1a6-9052-46f5-b4ee-cddbee259280 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.801275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d1a6-9052-46f5-b4ee-cddbee259280 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.801560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82d1a6-9052-46f5-b4ee-cddbee259280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.830392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ee82d1a6-9052-46f5-b4ee-cddbee259280 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:03.832017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ee82d1a6-9052-46f5-b4ee-cddbee259280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:03.846037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1070/2139] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:03.847631 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8de5-26c0-4775-a8cb-5384e6c8c4ec None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:03.859746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd8de5-26c0-4775-a8cb-5384e6c8c4ec None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:03.873027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:03.874214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.874906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.875382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.876926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:03.877788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:03.884352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:03.901975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1070/2140] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:03.906861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82d1a6-9052-46f5-b4ee-cddbee259280 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:03.917523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82d1a6-9052-46f5-b4ee-cddbee259280 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:03.922360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:03.922993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:03.923282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:03.923546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:03.924225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:03.939520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:03.978542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1071/2141] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:03 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:03.982816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:03.994585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6468e-827a-4ced-afc1-7960e058ace7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:04.060947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:04.061722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:04.062136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:04.062504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:04.063643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:04.065541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:04.085551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:04.092914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1071/2142] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:03 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:22:04.101598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:04.113989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853188a-3cbc-41cf-85d4-e347c5870821 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:04.119727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:04.120465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:04.120820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:04.121235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:04.122280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:04.124129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:04.136794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1072/2143] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:04.141777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:04.153755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f577f-32fb-4a1d-af07-d39254a9f2ec admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:04.159014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ba1fb-5bd9-4667-8ff3-75f707fd70d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:04.159673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ba1fb-5bd9-4667-8ff3-75f707fd70d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:04.160180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ba1fb-5bd9-4667-8ff3-75f707fd70d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:04.160309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ba1fb-5bd9-4667-8ff3-75f707fd70d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:04.160951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ba1fb-5bd9-4667-8ff3-75f707fd70d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:04.162716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ba1fb-5bd9-4667-8ff3-75f707fd70d8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:04.177641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1072/2144] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:04.182706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:04.200882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112453bb-8027-4bdc-b3fb-bf3cc5d079c9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:04.205814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:04.206809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:04.207128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:04.207553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] PATH_INFO: `/v3/projects/d1aebd6be49542069ecd39811ccd06d1/users/c27140b243e34be8b4a94501094121e1/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:04.225374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1aebd6be49542069ecd39811ccd06d1, user_id=c27140b243e34be8b4a94501094121e1, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:04.228160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:04.262861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1073/2145] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:04 2022] PUT /identity/v3/projects/d1aebd6be49542069ecd39811ccd06d1/users/c27140b243e34be8b4a94501094121e1/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:04.275900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24f3e-0b42-4070-a457-0e3dd06ebd1f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:04.276653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24f3e-0b42-4070-a457-0e3dd06ebd1f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:04.277030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24f3e-0b42-4070-a457-0e3dd06ebd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:04.321527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6cb24f3e-0b42-4070-a457-0e3dd06ebd1f None None] MFA Rules not processed for user `c27140b243e34be8b4a94501094121e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:04.323119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6cb24f3e-0b42-4070-a457-0e3dd06ebd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:04.402402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1073/2146] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:04.416257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:04.426654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:04.528488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f896d-773e-4525-912b-d0ae72e82b5b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:04.532570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:04.533208 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:04.533488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:04.533763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:04.543231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:04.544731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:04.554145 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1074/2147] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:05.928583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15499bf-6f8a-4808-b8d7-ef434240db8e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:05.929117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15499bf-6f8a-4808-b8d7-ef434240db8e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:05.929117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15499bf-6f8a-4808-b8d7-ef434240db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:05.948753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a15499bf-6f8a-4808-b8d7-ef434240db8e None None] MFA Rules not processed for user `c27140b243e34be8b4a94501094121e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:05.949960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a15499bf-6f8a-4808-b8d7-ef434240db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:05.958168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1074/2148] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:08.093398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:08.095059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:08.168607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a8bb8-86a8-421a-bab1-04f8f6842e63 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:08.173232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:08.173899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:08.174217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:08.174495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] PATH_INFO: `/v3/users/0beb4291f27646a988c91fe5c95ec252` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:08.175775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0beb4291f27646a988c91fe5c95ec252)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:08.177751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:08.199554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:08.226280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0beb4291f27646a988c91fe5c95ec252'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.233267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0beb4291f27646a988c91fe5c95ec252'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.234136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0beb4291f27646a988c91fe5c95ec252'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.246969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0beb4291f27646a988c91fe5c95ec252'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.258709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0beb4291f27646a988c91fe5c95ec252'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.265231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1075/2149] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:08 2022] DELETE /identity/v3/users/0beb4291f27646a988c91fe5c95ec252 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:08.448023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15499bf-6f8a-4808-b8d7-ef434240db8e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:08.460271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15499bf-6f8a-4808-b8d7-ef434240db8e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:08.528367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:08.529283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:08.529530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:08.530034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] PATH_INFO: `/v3/projects/145a60b46c754e24a42d55538157a0c1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:08.531382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] RBAC: Authorizing `identity:delete_project(project_id=145a60b46c754e24a42d55538157a0c1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:08.533337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:08.578673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145a60b46c754e24a42d55538157a0c1', 'request_id': 'req-8e5535f3-8efe-43a2-8eef-62f21ffa869e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.587342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145a60b46c754e24a42d55538157a0c1', 'request_id': 'req-8e5535f3-8efe-43a2-8eef-62f21ffa869e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.594524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145a60b46c754e24a42d55538157a0c1', 'request_id': 'req-8e5535f3-8efe-43a2-8eef-62f21ffa869e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.605811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:08.611054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] The token cache is being invalidate because project 145a60b46c754e24a42d55538157a0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:08.611338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.612464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.614847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1075/2150] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:08 2022] DELETE /identity/v3/projects/145a60b46c754e24a42d55538157a0c1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:22:08.619457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:08.621026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:08.636293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad97e3b-9a83-407f-8c55-f049d9545d54 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:08.701701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:08.702714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:08.702976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:08.703248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] PATH_INFO: `/v3/users/f5b3f9c09d76443da763b590ac966230` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:08.704519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b3f9c09d76443da763b590ac966230)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:08.706515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:08.762443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b3f9c09d76443da763b590ac966230'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.769775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b3f9c09d76443da763b590ac966230'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.770476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b3f9c09d76443da763b590ac966230'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.782279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b3f9c09d76443da763b590ac966230'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.790993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e6f3ca0d-9c50-42c8-af07-d255166d3551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b3f9c09d76443da763b590ac966230'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:08.797281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1076/2151] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:08 2022] DELETE /identity/v3/users/f5b3f9c09d76443da763b590ac966230 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:09.059616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.061212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:09.074376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5535f3-8efe-43a2-8eef-62f21ffa869e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.142286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.143078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.143426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.143768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] PATH_INFO: `/v3/projects/7b888416672649eb8bab0db4fc9482fc` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.145006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b888416672649eb8bab0db4fc9482fc)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.147040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.196207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b888416672649eb8bab0db4fc9482fc', 'request_id': 'req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:09.203767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b888416672649eb8bab0db4fc9482fc', 'request_id': 'req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:09.209141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b888416672649eb8bab0db4fc9482fc', 'request_id': 'req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:09.221671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] The token cache is being invalidate because project 7b888416672649eb8bab0db4fc9482fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:09.221985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:09.222645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2bd1a04a-0cba-49cc-b888-7e6cffaec9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:09.224213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1076/2152] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:09 2022] DELETE /identity/v3/projects/7b888416672649eb8bab0db4fc9482fc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:09.229229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86894ec-954a-4a63-951a-5403b7b31a9a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.229700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86894ec-954a-4a63-951a-5403b7b31a9a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.229831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86894ec-954a-4a63-951a-5403b7b31a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.250581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f86894ec-954a-4a63-951a-5403b7b31a9a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:09.251850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f86894ec-954a-4a63-951a-5403b7b31a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:09.263823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:09.315112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1077/2153] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:09.323988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598a8eb-fbe7-4ec3-be49-135d320b63cd None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.324275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598a8eb-fbe7-4ec3-be49-135d320b63cd None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.325337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598a8eb-fbe7-4ec3-be49-135d320b63cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.347046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1598a8eb-fbe7-4ec3-be49-135d320b63cd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:09.348404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1598a8eb-fbe7-4ec3-be49-135d320b63cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:09.358573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1077/2154] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:09.362949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86894ec-954a-4a63-951a-5403b7b31a9a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.373062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86894ec-954a-4a63-951a-5403b7b31a9a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.378147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.378814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.379281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.379578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.380289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:09.380598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.382273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.399468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1078/2155] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:09.403880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598a8eb-fbe7-4ec3-be49-135d320b63cd None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.415258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598a8eb-fbe7-4ec3-be49-135d320b63cd None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.420315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.421017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.421956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.422260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.423063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.425215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.457675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1078/2156] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:09 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:09.459228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.469696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5fe1b-930e-42a9-9607-b7a4ac604c8d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.531557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.532216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.532508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.532785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.533497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.535515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.558490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1079/2157] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:09 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:09.562966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.573861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34071694-9fca-45fa-9e36-30e69796a833 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.579209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.579832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.580102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.580365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.581062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.582714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.593111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1079/2158] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:09.597156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.607634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dee3c-c31f-44b4-84e1-05a0e87f24a9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.612573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c026d-b2ed-4d41-8edb-f0d4f555d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.613180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c026d-b2ed-4d41-8edb-f0d4f555d753 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.613456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c026d-b2ed-4d41-8edb-f0d4f555d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.613734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c026d-b2ed-4d41-8edb-f0d4f555d753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.614481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c026d-b2ed-4d41-8edb-f0d4f555d753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.616080 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c026d-b2ed-4d41-8edb-f0d4f555d753 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.627243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1080/2159] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:09.632015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.642729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e57d1-1ec3-43a9-bf2a-dc2216dd5cf4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.648063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.648722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.649029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.649297 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] PATH_INFO: `/v3/projects/679f273cba654c48bb4ab00f11ebbcdf/users/3df7bf8b92d54a43b506d254d8280b37/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.664875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=679f273cba654c48bb4ab00f11ebbcdf, user_id=3df7bf8b92d54a43b506d254d8280b37, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.667636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.682624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1080/2160] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:09 2022] PUT /identity/v3/projects/679f273cba654c48bb4ab00f11ebbcdf/users/3df7bf8b92d54a43b506d254d8280b37/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:09.693056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5339-ed0e-407c-aef6-0e3aa7ced402 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.693331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5339-ed0e-407c-aef6-0e3aa7ced402 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.693602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5339-ed0e-407c-aef6-0e3aa7ced402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.729904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-89fb5339-ed0e-407c-aef6-0e3aa7ced402 None None] MFA Rules not processed for user `3df7bf8b92d54a43b506d254d8280b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:09.731215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89fb5339-ed0e-407c-aef6-0e3aa7ced402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:09.795265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1081/2161] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:09.806408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:09.808408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:09.842459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:09.872095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e4e14-ddf3-4115-853c-b4ed8a2789d5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:09.875992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81578e-99df-4e7b-a642-3b62bd2ef775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:09.876626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81578e-99df-4e7b-a642-3b62bd2ef775 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:09.877037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81578e-99df-4e7b-a642-3b62bd2ef775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:09.877311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81578e-99df-4e7b-a642-3b62bd2ef775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:09.886745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81578e-99df-4e7b-a642-3b62bd2ef775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:09.888337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81578e-99df-4e7b-a642-3b62bd2ef775 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:09.898685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1081/2162] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:15.573072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5339-ed0e-407c-aef6-0e3aa7ced402 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:15.586413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:15.637046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5339-ed0e-407c-aef6-0e3aa7ced402 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:15.641772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:15.642458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.642732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.643002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] PATH_INFO: `/v3/users/3df7bf8b92d54a43b506d254d8280b37` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.644183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df7bf8b92d54a43b506d254d8280b37)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:15.646141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:15.692827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df7bf8b92d54a43b506d254d8280b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:15.699449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df7bf8b92d54a43b506d254d8280b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:15.700148 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df7bf8b92d54a43b506d254d8280b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:15.711704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df7bf8b92d54a43b506d254d8280b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:15.719315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df7bf8b92d54a43b506d254d8280b37'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:15.725588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1082/2163] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:15 2022] DELETE /identity/v3/users/3df7bf8b92d54a43b506d254d8280b37 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:15.730621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.731055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.731393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.751278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:15.752491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:15.820582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1082/2164] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:15.832986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:15.834664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:15.908075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b733b-75bb-4c74-b6ab-319381fbf909 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:15.912042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c327831-f533-47b0-b1f6-d7d68739c1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:15.913335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c327831-f533-47b0-b1f6-d7d68739c1be service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:15.913621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c327831-f533-47b0-b1f6-d7d68739c1be service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:15.913896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c327831-f533-47b0-b1f6-d7d68739c1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:15.924552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c327831-f533-47b0-b1f6-d7d68739c1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:15.926090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c327831-f533-47b0-b1f6-d7d68739c1be service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:15.937468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1083/2165] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:16.400466 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.402713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:16.417960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a284-d3b6-4023-8ff0-7eda9d3bc10a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.423586 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.424318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.424556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.424833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] PATH_INFO: `/v3/projects/679f273cba654c48bb4ab00f11ebbcdf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.426044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=679f273cba654c48bb4ab00f11ebbcdf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.428116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.478359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679f273cba654c48bb4ab00f11ebbcdf', 'request_id': 'req-4a47137c-29af-447f-8cc4-361ebea9a6a3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:16.488338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679f273cba654c48bb4ab00f11ebbcdf', 'request_id': 'req-4a47137c-29af-447f-8cc4-361ebea9a6a3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:16.494806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679f273cba654c48bb4ab00f11ebbcdf', 'request_id': 'req-4a47137c-29af-447f-8cc4-361ebea9a6a3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:16.513098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] The token cache is being invalidate because project 679f273cba654c48bb4ab00f11ebbcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:16.513390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:16.514095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-4a47137c-29af-447f-8cc4-361ebea9a6a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:16.515665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1083/2166] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:16 2022] DELETE /identity/v3/projects/679f273cba654c48bb4ab00f11ebbcdf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:16.520917 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598cbb-2293-4674-ac9a-520c175db634 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.521197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598cbb-2293-4674-ac9a-520c175db634 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.521502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0598cbb-2293-4674-ac9a-520c175db634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.545885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a0598cbb-2293-4674-ac9a-520c175db634 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:16.547212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a0598cbb-2293-4674-ac9a-520c175db634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:16.587121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:16.625090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1084/2167] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:16.633046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581a2d-6aaf-4dec-b3db-cb5912eeff6a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.633371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581a2d-6aaf-4dec-b3db-cb5912eeff6a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.633678 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4581a2d-6aaf-4dec-b3db-cb5912eeff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.659687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e4581a2d-6aaf-4dec-b3db-cb5912eeff6a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:16.660973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e4581a2d-6aaf-4dec-b3db-cb5912eeff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:16.671046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1084/2168] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:16.676514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0598cbb-2293-4674-ac9a-520c175db634 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.688406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0598cbb-2293-4674-ac9a-520c175db634 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.695882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.696597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.696796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.697071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.697869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:16.698165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.699745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.713258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1085/2169] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:16.717825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581a2d-6aaf-4dec-b3db-cb5912eeff6a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.729569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4581a2d-6aaf-4dec-b3db-cb5912eeff6a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.741304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.742457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.743909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.744117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.744843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.748676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.783985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1085/2170] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:16 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:22:16.787192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.803215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c6fba-0d79-4844-beed-2d2adbd61397 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.863510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.864274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.864623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.865455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.866282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.868745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.894055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1086/2171] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:16 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:16.898347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.910673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a0d6f-13a0-46b2-8878-17776a1f9242 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.919182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.920326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.920665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.921079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.922460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.925022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.940714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1086/2172] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:16.942831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.955706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4b17-d923-4657-811f-ad2b3cf187c0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:16.961846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cde3c6-2703-41ca-b4b8-1dc3390e1d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:16.962509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cde3c6-2703-41ca-b4b8-1dc3390e1d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:16.962788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cde3c6-2703-41ca-b4b8-1dc3390e1d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:16.963096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cde3c6-2703-41ca-b4b8-1dc3390e1d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:16.963774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cde3c6-2703-41ca-b4b8-1dc3390e1d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:16.965390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cde3c6-2703-41ca-b4b8-1dc3390e1d91 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:16.977048 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1087/2173] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:16.981439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:16.997519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0c0e-be57-4d0d-b23a-38f2891859d4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:17.005571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:17.006622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:17.007033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:17.007427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] PATH_INFO: `/v3/projects/d4b087bfe4c14f7eab16d56a19907b0f/users/6ce6e07b0c6b4ab4a42576f166498ed4/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:17.022879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:17.028676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b087bfe4c14f7eab16d56a19907b0f, user_id=6ce6e07b0c6b4ab4a42576f166498ed4, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:17.032346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:17.048397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1087/2174] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:16 2022] PUT /identity/v3/projects/d4b087bfe4c14f7eab16d56a19907b0f/users/6ce6e07b0c6b4ab4a42576f166498ed4/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:17.059759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d78e-6dcd-48e5-ac02-9c16ed734743 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:17.060040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d78e-6dcd-48e5-ac02-9c16ed734743 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:17.060314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d78e-6dcd-48e5-ac02-9c16ed734743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:17.088207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6cb3d78e-6dcd-48e5-ac02-9c16ed734743 None None] MFA Rules not processed for user `6ce6e07b0c6b4ab4a42576f166498ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:17.089402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6cb3d78e-6dcd-48e5-ac02-9c16ed734743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:17.166180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1088/2175] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:17.177336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:17.179389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:17.252421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230bca8-bab1-4f32-ba3e-745943fb8c21 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:17.257217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:17.258121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:17.258968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:17.259406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:17.282122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:17.283588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:17.293546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1088/2176] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:20.346522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62d29-8441-4af4-ae09-1a72b9601a5d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:20.347057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62d29-8441-4af4-ae09-1a72b9601a5d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:20.347057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62d29-8441-4af4-ae09-1a72b9601a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:20.366374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c6f62d29-8441-4af4-ae09-1a72b9601a5d None None] MFA Rules not processed for user `46c3c63c45ed4882bd7b4b70bea2f613`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:20.368110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c6f62d29-8441-4af4-ae09-1a72b9601a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:20.393968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:20.420794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:20.435546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1089/2177] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:20.522002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44f70-d5d6-4885-97af-7a813c85071b service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:20.527596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:20.528346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:20.528695 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:20.529036 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] PATH_INFO: `/v3/users/6ce6e07b0c6b4ab4a42576f166498ed4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:20.530915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce6e07b0c6b4ab4a42576f166498ed4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:20.532912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:20.596192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce6e07b0c6b4ab4a42576f166498ed4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:20.604776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce6e07b0c6b4ab4a42576f166498ed4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:20.619680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce6e07b0c6b4ab4a42576f166498ed4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:20.630534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce6e07b0c6b4ab4a42576f166498ed4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:20.643845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce6e07b0c6b4ab4a42576f166498ed4'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:20.655240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1089/2178] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:20 2022] DELETE /identity/v3/users/6ce6e07b0c6b4ab4a42576f166498ed4 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:22:20.660683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:20.660977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:20.661256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:20.681781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:20.683036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:20.756536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1090/2179] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:20.764490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:20.769272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:20.783202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:20.841022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b46b2-27ba-4221-899a-c5b8b9c52f59 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:20.846346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a8c2-54dd-4a4b-8ee1-4a61ea83a216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:20.847194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a8c2-54dd-4a4b-8ee1-4a61ea83a216 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:20.847629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a8c2-54dd-4a4b-8ee1-4a61ea83a216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:20.848092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a8c2-54dd-4a4b-8ee1-4a61ea83a216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:20.862662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649a8c2-54dd-4a4b-8ee1-4a61ea83a216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:20.864205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649a8c2-54dd-4a4b-8ee1-4a61ea83a216 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:20.884528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1090/2180] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:22:21.385500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.388296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:21.406529 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd068f7f-6381-47a4-9cd7-2c08f965f9eb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.412642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.413572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.413844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.414500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] PATH_INFO: `/v3/projects/d4b087bfe4c14f7eab16d56a19907b0f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.415957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b087bfe4c14f7eab16d56a19907b0f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.418081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.473689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b087bfe4c14f7eab16d56a19907b0f', 'request_id': 'req-523f270f-c84a-433a-aaa4-af7e1594b450'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:21.487345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b087bfe4c14f7eab16d56a19907b0f', 'request_id': 'req-523f270f-c84a-433a-aaa4-af7e1594b450'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:21.495143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b087bfe4c14f7eab16d56a19907b0f', 'request_id': 'req-523f270f-c84a-433a-aaa4-af7e1594b450'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:21.509147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] The token cache is being invalidate because project d4b087bfe4c14f7eab16d56a19907b0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:21.509516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:21.510449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-523f270f-c84a-433a-aaa4-af7e1594b450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:21.515414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1091/2181] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:21 2022] DELETE /identity/v3/projects/d4b087bfe4c14f7eab16d56a19907b0f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:21.518331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff665f-7582-4346-be8d-24aced3f6b3c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.518809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff665f-7582-4346-be8d-24aced3f6b3c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.519259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff665f-7582-4346-be8d-24aced3f6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.547193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-93ff665f-7582-4346-be8d-24aced3f6b3c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:21.548492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-93ff665f-7582-4346-be8d-24aced3f6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:21.611799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1091/2182] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:21.620006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83b0a-35ad-44d4-a57c-6e275367888a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.620295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83b0a-35ad-44d4-a57c-6e275367888a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.620576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83b0a-35ad-44d4-a57c-6e275367888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.642315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f3e83b0a-35ad-44d4-a57c-6e275367888a None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:21.643548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3e83b0a-35ad-44d4-a57c-6e275367888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:21.652130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1092/2183] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:21.659053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff665f-7582-4346-be8d-24aced3f6b3c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.671864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff665f-7582-4346-be8d-24aced3f6b3c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.677592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.678250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.678521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.678790 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.679492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:21.679800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.681418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.693946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1092/2184] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:21.698481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83b0a-35ad-44d4-a57c-6e275367888a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.708810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83b0a-35ad-44d4-a57c-6e275367888a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.714199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.714855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.715118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.715389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.716090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.718049 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.748951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1093/2185] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:21 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:21.754666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.765332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8557fef-748c-4348-a0cc-1e356ae61078 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.829409 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.830067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.830337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.830601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.831282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.833216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.857735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1093/2186] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:21 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:21.862246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.873910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ca1c8-e94b-4c17-a6fb-875b5a31207b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.879199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.879823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.880109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.880373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.881070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.882759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.893912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1094/2187] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:21.898259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.909095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2cab1-d243-48aa-a9ec-c536fa15d616 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.914998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97fc7c-27d1-4897-9e79-baa338d12386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.915611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97fc7c-27d1-4897-9e79-baa338d12386 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.915890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97fc7c-27d1-4897-9e79-baa338d12386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.916162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97fc7c-27d1-4897-9e79-baa338d12386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.916874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97fc7c-27d1-4897-9e79-baa338d12386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.918523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97fc7c-27d1-4897-9e79-baa338d12386 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.929724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1094/2188] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:21.934623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:21.950398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a585f2-aa28-4552-82e4-be1b2e3518a5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:21.958594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:21.959266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:21.959673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:21.959922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] PATH_INFO: `/v3/projects/52f1b0bd5ec64a9389ab5bcda1a5bb94/users/fd0db8cbf23b4100a72ab7b792c58168/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:21.975886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f1b0bd5ec64a9389ab5bcda1a5bb94, user_id=fd0db8cbf23b4100a72ab7b792c58168, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:21.978714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:21.981975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:21.996561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1095/2189] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:21 2022] PUT /identity/v3/projects/52f1b0bd5ec64a9389ab5bcda1a5bb94/users/fd0db8cbf23b4100a72ab7b792c58168/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:22.008342 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7781f-4d7a-4535-b712-3f402f87f52e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.008634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7781f-4d7a-4535-b712-3f402f87f52e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.008898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7781f-4d7a-4535-b712-3f402f87f52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.038556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fbf7781f-4d7a-4535-b712-3f402f87f52e None None] MFA Rules not processed for user `fd0db8cbf23b4100a72ab7b792c58168`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:22.039719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fbf7781f-4d7a-4535-b712-3f402f87f52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:22.049085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:22.111060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1095/2190] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:22.115095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.190424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068dcfc-d12c-46b2-996e-7b3effc137c4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.195576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.196149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.196461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.196733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.197458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.199661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.235114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1096/2191] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:22 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:22:22.236733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7781f-4d7a-4535-b712-3f402f87f52e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.249432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7781f-4d7a-4535-b712-3f402f87f52e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.316778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.317430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.317713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.318021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.318704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.320803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.347196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1096/2192] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:22 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:22.351914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.371643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198cd0-288a-41d9-b724-b7a485d9549b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.377312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.379599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.379995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.380423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.381249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.383059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.395491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1097/2193] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:22:22.399255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.409327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1e884-41e6-46ec-a5f2-8b72b092a04b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.414100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811c273-ca87-4f7b-9ffd-c17c27b9d103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.414726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c273-ca87-4f7b-9ffd-c17c27b9d103 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.415159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c273-ca87-4f7b-9ffd-c17c27b9d103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.415435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c273-ca87-4f7b-9ffd-c17c27b9d103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.416205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811c273-ca87-4f7b-9ffd-c17c27b9d103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.417804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811c273-ca87-4f7b-9ffd-c17c27b9d103 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.428081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1097/2194] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:22:22.432103 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.442908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2ddc-2b8c-4def-82a9-d14df61c6d4b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.447735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.448470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.448750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.449024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] PATH_INFO: `/v3/projects/029895c6f03147b7bd359aa894939152/users/7ff203d9ae5140759c7831fa334c255b/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.464524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] RBAC: Authorizing `identity:create_grant(project_id=029895c6f03147b7bd359aa894939152, user_id=7ff203d9ae5140759c7831fa334c255b, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.467229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.490009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1098/2195] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:22 2022] PUT /identity/v3/projects/029895c6f03147b7bd359aa894939152/users/7ff203d9ae5140759c7831fa334c255b/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:22.495575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fcbb2-14f1-4441-873f-94ea55824938 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.495575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fcbb2-14f1-4441-873f-94ea55824938 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.495575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fcbb2-14f1-4441-873f-94ea55824938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.528477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-565fcbb2-14f1-4441-873f-94ea55824938 None None] MFA Rules not processed for user `7ff203d9ae5140759c7831fa334c255b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:22.529799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-565fcbb2-14f1-4441-873f-94ea55824938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:22.627271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1098/2196] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:22.631751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.699019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaada3a-89f6-4011-985c-e3611faa424c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.704141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.704763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.705044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.705318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.706023 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.707965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.740469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1099/2197] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:22 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:22.745069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fcbb2-14f1-4441-873f-94ea55824938 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.756555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fcbb2-14f1-4441-873f-94ea55824938 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.770067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:22.816752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.817452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.817738 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.818039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.818710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.820677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.843727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1099/2198] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:22 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:22.848113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.860794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60722b-f253-44c8-9511-3b29696213f5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.867914 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.868659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.869005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.869408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.870233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.871871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.883518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1100/2199] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:22.887812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.898303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15f4e2-cc21-4acd-8409-d8d22440b647 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.903754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:22.904451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:22.904737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:22.905010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] PATH_INFO: `/v3/projects/c39e791eb43b43d3ab884ab732f8f06e/users/05b888893faa4963aeaa277e2153fa72/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:22.921680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39e791eb43b43d3ab884ab732f8f06e, user_id=05b888893faa4963aeaa277e2153fa72, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:22.924494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:22.940096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1100/2200] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:22 2022] PUT /identity/v3/projects/c39e791eb43b43d3ab884ab732f8f06e/users/05b888893faa4963aeaa277e2153fa72/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:22.944195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:22.954822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185a8e0-d3c6-420f-8017-eaae4e3996e6 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:22.973154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:23.015008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8db1e-3dbf-4332-aeba-d197d1678444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:23.015632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8db1e-3dbf-4332-aeba-d197d1678444 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:23.015908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8db1e-3dbf-4332-aeba-d197d1678444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:23.016176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8db1e-3dbf-4332-aeba-d197d1678444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:23.016867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8db1e-3dbf-4332-aeba-d197d1678444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:23.018505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8db1e-3dbf-4332-aeba-d197d1678444 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:23.028685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1101/2201] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:23.032970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:23.043646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db380c-dd38-4dd5-9f0d-29da9537a8fc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:23.048714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:23.049562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:23.049720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:23.049978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] PATH_INFO: `/v3/projects/c39e791eb43b43d3ab884ab732f8f06e/users/05b888893faa4963aeaa277e2153fa72/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:23.052427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39e791eb43b43d3ab884ab732f8f06e, user_id=05b888893faa4963aeaa277e2153fa72, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:23.055120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:23.066300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1101/2202] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:23 2022] PUT /identity/v3/projects/c39e791eb43b43d3ab884ab732f8f06e/users/05b888893faa4963aeaa277e2153fa72/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:22:23.076915 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:23.077102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:23.077395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:23.106936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] MFA Rules not processed for user `05b888893faa4963aeaa277e2153fa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:23.108168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:23.180530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1102/2203] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:23.192284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:23.194117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:23.260935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816ecc-2ad3-4e84-90c9-a2835907a93c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:23.265599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:23.266632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:23.266908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:23.267277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:23.329523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:23.330926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:23.340540 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1102/2204] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:25.001130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:25.002634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:25.015328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a0e77-d4ff-4f0d-9717-b12ff7f83169 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:25.019035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658cec8-2cb2-4cb3-8f40-034c579142fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:25.019845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658cec8-2cb2-4cb3-8f40-034c579142fe service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:25.020064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658cec8-2cb2-4cb3-8f40-034c579142fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:25.020377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658cec8-2cb2-4cb3-8f40-034c579142fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:25.086531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658cec8-2cb2-4cb3-8f40-034c579142fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:25.088052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658cec8-2cb2-4cb3-8f40-034c579142fe service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:25.100351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1103/2205] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:22:25.694666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:25.703835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5fd0-213e-456e-9a26-34fe730e3a25 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:25.707504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:25.708125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:25.708429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:25.708699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:25.718223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:25.719657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:25.729290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1103/2206] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:28.825029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6715ea-b10d-4766-b3f3-9da63d89a2a9 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:28.825515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6715ea-b10d-4766-b3f3-9da63d89a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:28.825608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6715ea-b10d-4766-b3f3-9da63d89a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:28.846554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1e6715ea-b10d-4766-b3f3-9da63d89a2a9 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:28.847863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1e6715ea-b10d-4766-b3f3-9da63d89a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:28.882796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:28.908057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1104/2207] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:22:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:28.949449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:28.950937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:28.964986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:29.024412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07eabb3-5046-4305-9c47-dd254d4998ca service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:29.030005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:29.030647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:29.030964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:29.031235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:29.039753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:29.041454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:29.049641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1104/2208] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:22:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:22:29.595975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d9-e87d-46b2-935f-67b1c8da4e6f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:29.596265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d9-e87d-46b2-935f-67b1c8da4e6f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:29.596549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d9-e87d-46b2-935f-67b1c8da4e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:29.615954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-df4547d9-e87d-46b2-935f-67b1c8da4e6f None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:29.617581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-df4547d9-e87d-46b2-935f-67b1c8da4e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:29.625457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1105/2209] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:29.640244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:29.653594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b7082-094e-4dcd-81ac-22dd0e6f8fb1 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:29.659305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c33834-f06c-4269-a603-899fb9075074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:29.659935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33834-f06c-4269-a603-899fb9075074 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:29.660211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33834-f06c-4269-a603-899fb9075074 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:29.660479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c33834-f06c-4269-a603-899fb9075074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:29.669693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c33834-f06c-4269-a603-899fb9075074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:29.671532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c33834-f06c-4269-a603-899fb9075074 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:29.684609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1105/2210] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:22:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:22:29.757015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d9-e87d-46b2-935f-67b1c8da4e6f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:29.829463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d9-e87d-46b2-935f-67b1c8da4e6f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:29.833957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:29.834626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:29.834901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:29.835167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] PATH_INFO: `/v3/users/fd0db8cbf23b4100a72ab7b792c58168` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:29.836367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0db8cbf23b4100a72ab7b792c58168)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:29.838374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:29.898795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0db8cbf23b4100a72ab7b792c58168'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:29.906295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0db8cbf23b4100a72ab7b792c58168'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:29.907019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0db8cbf23b4100a72ab7b792c58168'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:29.922349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0db8cbf23b4100a72ab7b792c58168'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:29.930582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e5fff798-94b1-46fc-80c5-d2a16f27a2a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0db8cbf23b4100a72ab7b792c58168'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:29.937597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1106/2211] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:29 2022] DELETE /identity/v3/users/fd0db8cbf23b4100a72ab7b792c58168 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:29.943074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:29.943400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:29.943759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:29.952198 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:29.952586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:29.952952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:29.969718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:29.971002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:29.973038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:29.974282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.035551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1107/2212] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:30.044852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1106/2213] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:30.047962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:30.049418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.054398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:30.063158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:30.065116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.126775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb02f2-917a-4ce8-a685-9adc88c47403 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:30.131388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab62bf-5a35-4864-aa06-f432c34f9e53 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:30.131833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:30.132515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:30.132798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:30.133143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:30.136676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a6d18-3424-411a-9584-ca57bb30bd33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:30.137496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6d18-3424-411a-9584-ca57bb30bd33 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:30.137797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6d18-3424-411a-9584-ca57bb30bd33 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:30.138104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a6d18-3424-411a-9584-ca57bb30bd33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:30.142938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:30.144628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:30.146813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6d18-3424-411a-9584-ca57bb30bd33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:30.148470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a6d18-3424-411a-9584-ca57bb30bd33 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:30.154795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1107/2214] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:22:30.156739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1108/2215] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:22:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 01:22:30.447740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:30.449234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.465471 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d949bd-ca36-40fb-9f1c-9e32dc4547e6 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:30.472824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:30.473862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:30.474394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:30.474733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] PATH_INFO: `/v3/projects/52f1b0bd5ec64a9389ab5bcda1a5bb94` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:30.476013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f1b0bd5ec64a9389ab5bcda1a5bb94)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:30.479177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:30.521798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:30.554783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f1b0bd5ec64a9389ab5bcda1a5bb94', 'request_id': 'req-556754aa-e713-4cca-9d82-705ffc8a78ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.563150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f1b0bd5ec64a9389ab5bcda1a5bb94', 'request_id': 'req-556754aa-e713-4cca-9d82-705ffc8a78ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.569503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f1b0bd5ec64a9389ab5bcda1a5bb94', 'request_id': 'req-556754aa-e713-4cca-9d82-705ffc8a78ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.585695 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] The token cache is being invalidate because project 52f1b0bd5ec64a9389ab5bcda1a5bb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:30.586119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810224e3-41f8-466f-a29b-14c206414375 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:30.586254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.586411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810224e3-41f8-466f-a29b-14c206414375 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:30.586816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810224e3-41f8-466f-a29b-14c206414375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:30.586937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.588741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1108/2216] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:30 2022] DELETE /identity/v3/projects/52f1b0bd5ec64a9389ab5bcda1a5bb94 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:30.592493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:30.593773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.607975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-810224e3-41f8-466f-a29b-14c206414375 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:30.609151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-810224e3-41f8-466f-a29b-14c206414375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.658747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556754aa-e713-4cca-9d82-705ffc8a78ee admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:30.663591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:30.664431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:30.664840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:30.664970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1109/2217] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 01:22:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:30.665061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] PATH_INFO: `/v3/users/7ff203d9ae5140759c7831fa334c255b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:30.666244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff203d9ae5140759c7831fa334c255b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:30.668188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:30.677343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810224e3-41f8-466f-a29b-14c206414375 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:30.678778 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-810224e3-41f8-466f-a29b-14c206414375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.726173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff203d9ae5140759c7831fa334c255b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.745310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff203d9ae5140759c7831fa334c255b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.762590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff203d9ae5140759c7831fa334c255b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.764989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff203d9ae5140759c7831fa334c255b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.767056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810224e3-41f8-466f-a29b-14c206414375 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:30.772688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:30.773526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:30.773654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff203d9ae5140759c7831fa334c255b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:30.773809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:30.774118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:30.776780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:30.780237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1109/2218] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:30 2022] DELETE /identity/v3/users/7ff203d9ae5140759c7831fa334c255b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:22:30.791676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:30.793311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:30.809643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1110/2219] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:22:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 01:22:31.176424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:31.179079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:31.240003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:31.287734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc04d3-af03-4818-adc4-18b966e884b3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:31.292598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:31.293254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:31.293529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:31.293799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] PATH_INFO: `/v3/projects/029895c6f03147b7bd359aa894939152` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:31.295259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] RBAC: Authorizing `identity:delete_project(project_id=029895c6f03147b7bd359aa894939152)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:31.297253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:31.350672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029895c6f03147b7bd359aa894939152', 'request_id': 'req-05623664-4b9c-47b9-adf2-ecd37f5c632e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.359186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029895c6f03147b7bd359aa894939152', 'request_id': 'req-05623664-4b9c-47b9-adf2-ecd37f5c632e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.364789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029895c6f03147b7bd359aa894939152', 'request_id': 'req-05623664-4b9c-47b9-adf2-ecd37f5c632e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.381792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] The token cache is being invalidate because project 029895c6f03147b7bd359aa894939152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:31.382215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.383088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.385010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1110/2220] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:31 2022] DELETE /identity/v3/projects/029895c6f03147b7bd359aa894939152 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:31.389412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:31.414794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6066e-3776-4e81-b948-3298c1583f2e service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:31.439293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:31.474611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:31.475271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:31.475560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:31.475838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] PATH_INFO: `/v3/users/05b888893faa4963aeaa277e2153fa72` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:31.477074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b888893faa4963aeaa277e2153fa72)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:31.479159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:31.535511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b888893faa4963aeaa277e2153fa72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.543016 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b888893faa4963aeaa277e2153fa72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.543861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b888893faa4963aeaa277e2153fa72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.556509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b888893faa4963aeaa277e2153fa72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.564356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-bc6b416f-b5ec-402f-827a-256361f490ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b888893faa4963aeaa277e2153fa72'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:31.570295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1111/2221] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:31 2022] DELETE /identity/v3/users/05b888893faa4963aeaa277e2153fa72 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:31.968823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:31.970961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:32.002742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05623664-4b9c-47b9-adf2-ecd37f5c632e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.063674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.064338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.064621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.064895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] PATH_INFO: `/v3/projects/c39e791eb43b43d3ab884ab732f8f06e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.066141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39e791eb43b43d3ab884ab732f8f06e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.068432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.115320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39e791eb43b43d3ab884ab732f8f06e', 'request_id': 'req-584c472f-4643-41e0-9f0c-bd424c3276a7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:32.123006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39e791eb43b43d3ab884ab732f8f06e', 'request_id': 'req-584c472f-4643-41e0-9f0c-bd424c3276a7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:32.129054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39e791eb43b43d3ab884ab732f8f06e', 'request_id': 'req-584c472f-4643-41e0-9f0c-bd424c3276a7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:32.130180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:32.143145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] The token cache is being invalidate because project c39e791eb43b43d3ab884ab732f8f06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:32.143430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:32.144115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-584c472f-4643-41e0-9f0c-bd424c3276a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:32.145653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1111/2222] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:31 2022] DELETE /identity/v3/projects/c39e791eb43b43d3ab884ab732f8f06e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:32.150804 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbeec2-6611-4980-a752-ed4febb4a474 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.151119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbeec2-6611-4980-a752-ed4febb4a474 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.151443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbeec2-6611-4980-a752-ed4febb4a474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.170980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6ccbeec2-6611-4980-a752-ed4febb4a474 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:32.172186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ccbeec2-6611-4980-a752-ed4febb4a474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:32.231886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1112/2223] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:32.240300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce642-9519-4a2d-b5a4-1ffd5120dd2c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.240800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce642-9519-4a2d-b5a4-1ffd5120dd2c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.240886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce642-9519-4a2d-b5a4-1ffd5120dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.263659 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ea1ce642-9519-4a2d-b5a4-1ffd5120dd2c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:32.265021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ea1ce642-9519-4a2d-b5a4-1ffd5120dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:32.285796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1112/2224] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:32.290306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbeec2-6611-4980-a752-ed4febb4a474 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.304737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbeec2-6611-4980-a752-ed4febb4a474 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.310986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.311740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.312110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.312389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.313892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:32.314286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.316078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.330260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1113/2225] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:32.339061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ce642-9519-4a2d-b5a4-1ffd5120dd2c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.350290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ce642-9519-4a2d-b5a4-1ffd5120dd2c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.357573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.358257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.358535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.358809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.359482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.361552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.400794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1113/2226] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:32 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:32.404945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.414971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b133934-87f4-4177-a6b3-ada322d10844 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.451374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:32.483822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.484413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.484694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.484973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.485664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.487652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.514263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1114/2227] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:32 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:32.518608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.531322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c96aa-f330-4f01-9acc-19ac6f207cdf admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.537022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.537661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.538117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.538391 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.539322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.540984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.551589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1114/2228] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:32.555743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.567695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cd921-eef7-465f-8e3f-10cb02080266 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.572736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb0a69-e585-4205-97fd-8ca15d15f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.573388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb0a69-e585-4205-97fd-8ca15d15f9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.573665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb0a69-e585-4205-97fd-8ca15d15f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.573951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb0a69-e585-4205-97fd-8ca15d15f9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.574667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb0a69-e585-4205-97fd-8ca15d15f9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.576278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb0a69-e585-4205-97fd-8ca15d15f9b8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.586469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1115/2229] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:32.590831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.600983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2040-c5b9-4ac6-8000-cc1b5530c821 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.605561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.606305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.606583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.606868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] PATH_INFO: `/v3/projects/d19f426370dc4b22b4185bc3f4b24554/users/28dce0946df04c95b826ec6d357f9810/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.623196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19f426370dc4b22b4185bc3f4b24554, user_id=28dce0946df04c95b826ec6d357f9810, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.625849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.639760 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1115/2230] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:32 2022] PUT /identity/v3/projects/d19f426370dc4b22b4185bc3f4b24554/users/28dce0946df04c95b826ec6d357f9810/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:22:32.650310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7b9d1-2e97-4bf3-9e8b-89fce13f66d8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.650586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7b9d1-2e97-4bf3-9e8b-89fce13f66d8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.650860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7b9d1-2e97-4bf3-9e8b-89fce13f66d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.680546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-95b7b9d1-2e97-4bf3-9e8b-89fce13f66d8 None None] MFA Rules not processed for user `28dce0946df04c95b826ec6d357f9810`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:32.681838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-95b7b9d1-2e97-4bf3-9e8b-89fce13f66d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:32.750478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1116/2231] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:32.763364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.765203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:32.826197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3db18-bdb7-4e90-9136-e846846885ee admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.831670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.832350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.832652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.832963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.844456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.845883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:32.855647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1116/2232] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:32.881096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7b9d1-2e97-4bf3-9e8b-89fce13f66d8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:32.959550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7b9d1-2e97-4bf3-9e8b-89fce13f66d8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:32.964922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:32.965291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:32.965573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:32.965864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] PATH_INFO: `/v3/users/28dce0946df04c95b826ec6d357f9810` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:32.967267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28dce0946df04c95b826ec6d357f9810)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:32.969234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:33.031052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:33.033994 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28dce0946df04c95b826ec6d357f9810'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.045687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28dce0946df04c95b826ec6d357f9810'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.046690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28dce0946df04c95b826ec6d357f9810'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.060089 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28dce0946df04c95b826ec6d357f9810'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.067617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f3e73a2-1631-425d-808d-c3827e2bba58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28dce0946df04c95b826ec6d357f9810'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.069308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:33.070890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:33.073792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1117/2233] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:32 2022] DELETE /identity/v3/users/28dce0946df04c95b826ec6d357f9810 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:33.078121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.079220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.079508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:33.088666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb11fc6-1721-45bd-8d83-8f8b60545b50 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:33.101544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:33.102818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:33.158584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:33.159470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.159900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.160151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] PATH_INFO: `/v3/users/c27140b243e34be8b4a94501094121e1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:33.162581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27140b243e34be8b4a94501094121e1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:33.165056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:33.175659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1118/2234] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:33.185898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:33.187590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:33.210967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:33.223356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27140b243e34be8b4a94501094121e1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.233723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27140b243e34be8b4a94501094121e1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.250184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27140b243e34be8b4a94501094121e1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.250827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891255f-aa3f-407d-be9e-91fbbd8237c8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:33.251585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27140b243e34be8b4a94501094121e1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.255187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:33.255906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.256130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.256408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:33.258851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-2d41635e-d2e2-452d-b204-ce816d781929 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27140b243e34be8b4a94501094121e1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.266420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1117/2235] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:33 2022] DELETE /identity/v3/users/c27140b243e34be8b4a94501094121e1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:22:33.267166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:33.268645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:33.271488 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.271799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.272075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:33.278881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1119/2236] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:22:33.292220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:33.293677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:33.373423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1118/2237] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:22:33.385692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:33.405601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d388877-6e46-4fce-a948-76870d61b31f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:33.462167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:33.462167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.462167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.462167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:33.471862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:33.473692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:33.487325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1120/2238] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:33.720480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:33.721696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:33.743164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45585191-cdcf-4edb-a1ee-7a77ba3bec51 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:33.758069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:33.758655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.758926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.759196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] PATH_INFO: `/v3/projects/d1aebd6be49542069ecd39811ccd06d1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:33.760389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1aebd6be49542069ecd39811ccd06d1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:33.762435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:33.799113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:33.801104 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:33.814811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4554a66-8380-492f-a23f-d8de5577c415 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:33.820181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1aebd6be49542069ecd39811ccd06d1', 'request_id': 'req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.820833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:33.846792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1aebd6be49542069ecd39811ccd06d1', 'request_id': 'req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.854280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1aebd6be49542069ecd39811ccd06d1', 'request_id': 'req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.865684 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] The token cache is being invalidate because project d1aebd6be49542069ecd39811ccd06d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:33.866108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.867199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5a34ceb7-6625-45ff-b80f-b22e9ea392c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.868915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1119/2239] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:33 2022] DELETE /identity/v3/projects/d1aebd6be49542069ecd39811ccd06d1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:33.887302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:33.887986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.888400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.888681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] PATH_INFO: `/v3/projects/d19f426370dc4b22b4185bc3f4b24554` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:33.890063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19f426370dc4b22b4185bc3f4b24554)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:33.892071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:33.944022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19f426370dc4b22b4185bc3f4b24554', 'request_id': 'req-205360f9-6d6f-44f7-815b-6fdce429cc8c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.952754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19f426370dc4b22b4185bc3f4b24554', 'request_id': 'req-205360f9-6d6f-44f7-815b-6fdce429cc8c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.959146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19f426370dc4b22b4185bc3f4b24554', 'request_id': 'req-205360f9-6d6f-44f7-815b-6fdce429cc8c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.972036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] The token cache is being invalidate because project d19f426370dc4b22b4185bc3f4b24554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:33.972321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.973073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-205360f9-6d6f-44f7-815b-6fdce429cc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:33.974942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1121/2240] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:33 2022] DELETE /identity/v3/projects/d19f426370dc4b22b4185bc3f4b24554 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:22:33.979938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea6b34-039d-457c-b0e0-9c4de05a41b3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:33.980309 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea6b34-039d-457c-b0e0-9c4de05a41b3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:33.980593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea6b34-039d-457c-b0e0-9c4de05a41b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.003029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4aea6b34-039d-457c-b0e0-9c4de05a41b3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:34.004296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4aea6b34-039d-457c-b0e0-9c4de05a41b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:34.042664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:34.076061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1120/2241] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:34.083819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21b96-1d6d-4742-ac1e-dc8227e77950 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.084105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21b96-1d6d-4742-ac1e-dc8227e77950 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.084377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb21b96-1d6d-4742-ac1e-dc8227e77950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.104544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-acb21b96-1d6d-4742-ac1e-dc8227e77950 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:34.105758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-acb21b96-1d6d-4742-ac1e-dc8227e77950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:34.113747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1122/2242] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:34.118538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea6b34-039d-457c-b0e0-9c4de05a41b3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:34.128617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea6b34-039d-457c-b0e0-9c4de05a41b3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:34.133214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:34.133841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.134153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.134485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.135189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:22:34.135494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:34.137103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:34.152912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1121/2243] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:22:34.154232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21b96-1d6d-4742-ac1e-dc8227e77950 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:34.163742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb21b96-1d6d-4742-ac1e-dc8227e77950 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:34.168660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:34.169283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.169557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.169923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.170649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:34.172562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:34.202497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1123/2244] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:22:34 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:34.206640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:34.216940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071311ea-a082-4d5d-9d91-75f2d93ffb10 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:34.274299 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:34.275040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.275470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.275819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.276574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:34.278618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:34.306953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1122/2245] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:22:34 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:22:34.311064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:34.321374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7525df-c339-414f-91f6-322fd5262a6f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:34.326092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:34.326709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.326988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.327263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.327991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:34.329613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:34.340268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1124/2246] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:34.344136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:34.355356 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655ab52-f131-402e-8c72-ca205011550d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:34.360310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88b790a-697c-4241-9c72-c10f72f5b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:34.360936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b790a-697c-4241-9c72-c10f72f5b6da admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.361224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b790a-697c-4241-9c72-c10f72f5b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.361616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88b790a-697c-4241-9c72-c10f72f5b6da admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.362371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b790a-697c-4241-9c72-c10f72f5b6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:34.363970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88b790a-697c-4241-9c72-c10f72f5b6da admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:34.375541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1123/2247] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:22:34.379903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:34.390511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c57c2-c978-4f14-8fbf-33c2efba82aa admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:34.395478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:34.396149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.396426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.396701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] PATH_INFO: `/v3/projects/626b65b4e8de4c389e41684c4742816e/users/9458fd32814f42c88d3233c496bcf081/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.412792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=626b65b4e8de4c389e41684c4742816e, user_id=9458fd32814f42c88d3233c496bcf081, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:34.415890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:34.433429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1125/2248] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:22:34 2022] PUT /identity/v3/projects/626b65b4e8de4c389e41684c4742816e/users/9458fd32814f42c88d3233c496bcf081/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:34.451593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163aa7-3c6b-4464-b264-8b83b01fb260 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.451990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163aa7-3c6b-4464-b264-8b83b01fb260 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.452323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d163aa7-3c6b-4464-b264-8b83b01fb260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.481871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8d163aa7-3c6b-4464-b264-8b83b01fb260 None None] MFA Rules not processed for user `9458fd32814f42c88d3233c496bcf081`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:34.483135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8d163aa7-3c6b-4464-b264-8b83b01fb260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:34.553026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1124/2249] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:34.565001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:34.566782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:34.613244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:34.642019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30aeca0-7be9-497e-9d02-ee4921c9ce66 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:34.647773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cf502-0641-4deb-8f92-498500772091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:34.648456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf502-0641-4deb-8f92-498500772091 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:34.648743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf502-0641-4deb-8f92-498500772091 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:34.649060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf502-0641-4deb-8f92-498500772091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:34.663143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf502-0641-4deb-8f92-498500772091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:34.665070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2cf502-0641-4deb-8f92-498500772091 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:34.682792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1126/2250] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:39.819026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163aa7-3c6b-4464-b264-8b83b01fb260 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:39.854784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:39.888407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d163aa7-3c6b-4464-b264-8b83b01fb260 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:39.893229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:39.893990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:39.894407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:39.894690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] PATH_INFO: `/v3/users/9458fd32814f42c88d3233c496bcf081` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:39.895880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9458fd32814f42c88d3233c496bcf081)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:39.897870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:39.949304 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9458fd32814f42c88d3233c496bcf081'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:39.961812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9458fd32814f42c88d3233c496bcf081'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:39.977443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9458fd32814f42c88d3233c496bcf081'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:39.978970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9458fd32814f42c88d3233c496bcf081'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:39.988464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9458fd32814f42c88d3233c496bcf081'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:39.999810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1125/2251] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:22:39 2022] DELETE /identity/v3/users/9458fd32814f42c88d3233c496bcf081 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:40.000898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:40.001371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:40.001486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:40.025721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:40.027019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:40.094406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1127/2252] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:40.115308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:40.117660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:40.202877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a3572-8963-463e-88fd-4f9d020b1394 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:40.207124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdbf7e-a3d8-4345-b75c-15e1a72853ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:40.207805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbf7e-a3d8-4345-b75c-15e1a72853ba service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:40.208075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbf7e-a3d8-4345-b75c-15e1a72853ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:40.208350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdbf7e-a3d8-4345-b75c-15e1a72853ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:40.218883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdbf7e-a3d8-4345-b75c-15e1a72853ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:40.220206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdbf7e-a3d8-4345-b75c-15e1a72853ba service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:40.234872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1126/2253] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:40.751399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:40.752869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:40.772480 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3305a4f-5e72-4875-ba7e-220a2954030e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:40.781316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:40.782095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:40.782369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:40.782551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] PATH_INFO: `/v3/projects/626b65b4e8de4c389e41684c4742816e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:40.783818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=626b65b4e8de4c389e41684c4742816e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:40.785745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:40.835160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626b65b4e8de4c389e41684c4742816e', 'request_id': 'req-7c4ed142-627d-4a8f-a896-99a1e8f82051'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:40.843417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626b65b4e8de4c389e41684c4742816e', 'request_id': 'req-7c4ed142-627d-4a8f-a896-99a1e8f82051'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:40.849603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626b65b4e8de4c389e41684c4742816e', 'request_id': 'req-7c4ed142-627d-4a8f-a896-99a1e8f82051'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:40.861326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] The token cache is being invalidate because project 626b65b4e8de4c389e41684c4742816e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:22:40.861614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:40.862388 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:22:40.863939 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1128/2254] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:22:40 2022] DELETE /identity/v3/projects/626b65b4e8de4c389e41684c4742816e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:22:41.942736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ba4e0-6af6-43d6-be2e-1160ddbbca0e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:41.943397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ba4e0-6af6-43d6-be2e-1160ddbbca0e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:41.943397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ba4e0-6af6-43d6-be2e-1160ddbbca0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:41.964723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6e7ba4e0-6af6-43d6-be2e-1160ddbbca0e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:41.965976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6e7ba4e0-6af6-43d6-be2e-1160ddbbca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:42.015984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:42.030208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1127/2255] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:42.076548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:42.078334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:42.142353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:22:42.159374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ed142-627d-4a8f-a896-99a1e8f82051 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:42.165484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:42.166142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:42.166420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:42.166693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:42.178909 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:42.180791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:42.192127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1129/2256] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:45.949012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2913ea-ef01-418c-a5f3-c609148ec396 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:45.949564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2913ea-ef01-418c-a5f3-c609148ec396 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:45.949564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2913ea-ef01-418c-a5f3-c609148ec396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:45.973704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6f2913ea-ef01-418c-a5f3-c609148ec396 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:45.974958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6f2913ea-ef01-418c-a5f3-c609148ec396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:45.984914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1128/2257] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:46.043521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:46.058452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40244d1a-0d22-4b64-a678-27859d995b7c service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:46.066743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9706a7-5cc8-4ec7-8e1d-2e5baff63086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:46.067423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9706a7-5cc8-4ec7-8e1d-2e5baff63086 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:46.067701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9706a7-5cc8-4ec7-8e1d-2e5baff63086 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:46.067972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9706a7-5cc8-4ec7-8e1d-2e5baff63086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:46.077118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9706a7-5cc8-4ec7-8e1d-2e5baff63086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:46.078765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9706a7-5cc8-4ec7-8e1d-2e5baff63086 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:46.089669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1130/2258] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:46.707459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0465c-29c3-4f2b-be17-f9c4ce37179b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:46.707741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0465c-29c3-4f2b-be17-f9c4ce37179b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:46.708058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0465c-29c3-4f2b-be17-f9c4ce37179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:46.727778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4ea0465c-29c3-4f2b-be17-f9c4ce37179b None None] MFA Rules not processed for user `bef2265fc5044f878ba35c90c24a634d`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:46.728971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4ea0465c-29c3-4f2b-be17-f9c4ce37179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:46.796004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1129/2259] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:22:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:50.260585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958974-b16a-43d3-9911-b83073788901 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:50.261348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958974-b16a-43d3-9911-b83073788901 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:50.261348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958974-b16a-43d3-9911-b83073788901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:50.288510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b5958974-b16a-43d3-9911-b83073788901 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:50.289880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b5958974-b16a-43d3-9911-b83073788901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:50.299074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1131/2260] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:50.326518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0465c-29c3-4f2b-be17-f9c4ce37179b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:50.340854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0465c-29c3-4f2b-be17-f9c4ce37179b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:50.347763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:50.348415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:50.348718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:50.348999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:50.358707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:50.360453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:50.372146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1130/2261] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:53.333337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b360c-3168-4cb5-a11a-f7864078fee3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:53.333905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b360c-3168-4cb5-a11a-f7864078fee3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:53.333905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b360c-3168-4cb5-a11a-f7864078fee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:53.354857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-4d3b360c-3168-4cb5-a11a-f7864078fee3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:53.356064 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4d3b360c-3168-4cb5-a11a-f7864078fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:53.365325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1132/2262] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:53.392996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:53.404764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9c9e9-0305-4054-b02c-624565982755 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:53.411742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:53.412352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:53.412646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:53.412938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:53.421645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:53.423266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:53.433051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1131/2263] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:22:58.575259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c391ba6-5e56-4b75-a89c-fa6c8da220ca None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:58.575772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c391ba6-5e56-4b75-a89c-fa6c8da220ca None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:58.575772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c391ba6-5e56-4b75-a89c-fa6c8da220ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:58.604728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8c391ba6-5e56-4b75-a89c-fa6c8da220ca None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:22:58.606565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8c391ba6-5e56-4b75-a89c-fa6c8da220ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:58.617266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1133/2264] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:22:58.647709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:22:58.649773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:22:58.665196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a7c05-a5db-474a-8d22-bd86aaadfb8d service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:22:58.671776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:22:58.672407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:22:58.672683 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:22:58.672955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:22:58.681654 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:22:58.683294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:22:58.693384 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1132/2265] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:02.804207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6a5f-cc56-4ec4-9adb-d4901c55b595 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:02.805083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6a5f-cc56-4ec4-9adb-d4901c55b595 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:02.805083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e6a5f-cc56-4ec4-9adb-d4901c55b595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:02.828387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1a5e6a5f-cc56-4ec4-9adb-d4901c55b595 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:02.829576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1a5e6a5f-cc56-4ec4-9adb-d4901c55b595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:02.838785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1134/2266] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:02.873771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:02.885830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a900962-4b6c-4707-891b-142df071c058 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:02.892149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173f14a-606e-4a2d-bd17-d05544a44a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:02.892766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173f14a-606e-4a2d-bd17-d05544a44a60 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:02.893042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173f14a-606e-4a2d-bd17-d05544a44a60 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:02.893312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173f14a-606e-4a2d-bd17-d05544a44a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:02.902250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173f14a-606e-4a2d-bd17-d05544a44a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:02.903878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173f14a-606e-4a2d-bd17-d05544a44a60 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:02.914139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1133/2267] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:12.823042 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:12.909386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=55 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:21.384310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33e868-4aae-4ca4-bd62-d113da82b7e7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:21.384846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33e868-4aae-4ca4-bd62-d113da82b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:21.384846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33e868-4aae-4ca4-bd62-d113da82b7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:21.404734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2b33e868-4aae-4ca4-bd62-d113da82b7e7 None None] MFA Rules not processed for user `0689cf10e21441568c7298885434eec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:21.405955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2b33e868-4aae-4ca4-bd62-d113da82b7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:21.466639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1135/2268] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:23:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:31.459120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:36.612793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6435-829d-4357-8d34-8e1d66af5b2c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.613331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6435-829d-4357-8d34-8e1d66af5b2c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.613331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de6435-829d-4357-8d34-8e1d66af5b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.635120 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-04de6435-829d-4357-8d34-8e1d66af5b2c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:36.636473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-04de6435-829d-4357-8d34-8e1d66af5b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:36.645334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1134/2269] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:36.674660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33e868-4aae-4ca4-bd62-d113da82b7e7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:36.688842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33e868-4aae-4ca4-bd62-d113da82b7e7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:36.694886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:36.696041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.696521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.696987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.707361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:36.709571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:36.720618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1136/2270] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:36.856406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a35432-3374-47b2-9afb-7761afe8dc31 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:36.856818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a35432-3374-47b2-9afb-7761afe8dc31 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:36.857163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a35432-3374-47b2-9afb-7761afe8dc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:36.879530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-22a35432-3374-47b2-9afb-7761afe8dc31 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:36.881311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-22a35432-3374-47b2-9afb-7761afe8dc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:36.947002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1135/2271] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:37.001952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:37.003374 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:37.072526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91f322-6c0d-469b-9798-bbaf96e60fb9 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:37.078536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:37.079171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:37.079457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:37.079733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:37.088352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:37.089959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:37.098160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1137/2272] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:23:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:23:42.172422 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8d54-8958-4a20-8519-abe8e22de2e9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:42.173476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8d54-8958-4a20-8519-abe8e22de2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:42.174002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa8d54-8958-4a20-8519-abe8e22de2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:42.206741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-91aa8d54-8958-4a20-8519-abe8e22de2e9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:42.208823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-91aa8d54-8958-4a20-8519-abe8e22de2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:42.220393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1136/2273] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:23:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:42.268533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:42.331317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dd08d-12d4-4a82-be1a-5e011db4f016 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:42.345820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:42.346716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:42.351776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:42.353682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:42.418891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:42.422727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:42.473108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1138/2274] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:45.252087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164ee6-c243-4ade-9510-55f213c2da50 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:45.252610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164ee6-c243-4ade-9510-55f213c2da50 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:45.252610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a164ee6-c243-4ade-9510-55f213c2da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:45.288229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4a164ee6-c243-4ade-9510-55f213c2da50 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:45.289739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4a164ee6-c243-4ade-9510-55f213c2da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:45.302637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1137/2275] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:45.342640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:45.357737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d8ca0-9a65-45a9-a65e-50ace2ccb74c service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:45.366102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:45.367463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:45.367984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:45.368602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:45.386034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:45.387670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:45.412389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1139/2276] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:50.505700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:50.506336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:50.506481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:50.527207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:50.528439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:50.537838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1138/2277] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:50.569185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:50.580590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f1a3-3d0f-4551-a43f-2a75e9e6536d service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:50.586784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0af27-a729-4e92-ac61-b3925dab9078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:50.587415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0af27-a729-4e92-ac61-b3925dab9078 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:50.587725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0af27-a729-4e92-ac61-b3925dab9078 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:50.587994 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0af27-a729-4e92-ac61-b3925dab9078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:50.597126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0af27-a729-4e92-ac61-b3925dab9078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:50.598803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0af27-a729-4e92-ac61-b3925dab9078 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:50.610326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1140/2278] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:52.563325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:52.566663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:52.644804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd7835-1469-445e-ad36-ac1fa3ffbde2 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:52.652461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:52.653457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:52.653906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:52.654351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:52.656343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:52.669440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:52.671038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:52.681133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1139/2279] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:54.747855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd0c8-4edd-405f-a9a4-2f5a85fb906d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:54.748357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd0c8-4edd-405f-a9a4-2f5a85fb906d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:54.748470 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47acd0c8-4edd-405f-a9a4-2f5a85fb906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:54.769427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-47acd0c8-4edd-405f-a9a4-2f5a85fb906d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:54.770683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-47acd0c8-4edd-405f-a9a4-2f5a85fb906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:54.780032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1141/2280] 10.222.0.30 () {58 vars in 1016 bytes} [Sat Aug 6 01:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:54.882296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:54.897458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc950ad-d058-4e06-a502-9842aef0e6af service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:54.904093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4c46f-644d-4c69-9851-7f708d9b20f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:54.904717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4c46f-644d-4c69-9851-7f708d9b20f9 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:54.904996 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4c46f-644d-4c69-9851-7f708d9b20f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:54.905270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4c46f-644d-4c69-9851-7f708d9b20f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:54.914151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4c46f-644d-4c69-9851-7f708d9b20f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:54.915773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4c46f-644d-4c69-9851-7f708d9b20f9 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:54.925482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1140/2281] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:56.790001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dbebc-fae1-4571-92a2-79e3975343e8 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:56.790571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dbebc-fae1-4571-92a2-79e3975343e8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:56.790571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dbebc-fae1-4571-92a2-79e3975343e8 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:56.791911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1142/2282] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:56.797884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697951-a2f4-48c2-9479-acfa9ffdd49e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:56.798349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697951-a2f4-48c2-9479-acfa9ffdd49e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:56.798600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697951-a2f4-48c2-9479-acfa9ffdd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:56.818803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9b697951-a2f4-48c2-9479-acfa9ffdd49e None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:56.820134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9b697951-a2f4-48c2-9479-acfa9ffdd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:56.830799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1141/2283] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:56.843218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dbebc-fae1-4571-92a2-79e3975343e8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:56.845051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-037dbebc-fae1-4571-92a2-79e3975343e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:56.927924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dbebc-fae1-4571-92a2-79e3975343e8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:56.931510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba7929-0234-4ad6-9527-28bf77bce852 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:56.932144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7929-0234-4ad6-9527-28bf77bce852 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:56.932426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7929-0234-4ad6-9527-28bf77bce852 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:56.932704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7929-0234-4ad6-9527-28bf77bce852 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:56.943260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba7929-0234-4ad6-9527-28bf77bce852 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:56.944284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba7929-0234-4ad6-9527-28bf77bce852 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:56.955633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1143/2284] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:57.028228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eebfc-fed8-44e2-994c-7a2f5dd5f056 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:57.028517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eebfc-fed8-44e2-994c-7a2f5dd5f056 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:57.028795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5eebfc-fed8-44e2-994c-7a2f5dd5f056 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:57.030277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1142/2285] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:23:57.035820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e59101-7ea6-4b81-b359-d3877dd21c9b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:57.036092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e59101-7ea6-4b81-b359-d3877dd21c9b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:57.036363 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e59101-7ea6-4b81-b359-d3877dd21c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:57.067953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b9e59101-7ea6-4b81-b359-d3877dd21c9b None None] MFA Rules not processed for user `ed70b6997f064f3f8fa68dea2a6eb470`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:57.069315 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b9e59101-7ea6-4b81-b359-d3877dd21c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:57.089237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:57.128933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1144/2286] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:23:57.141321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eebfc-fed8-44e2-994c-7a2f5dd5f056 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:57.143070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ac5eebfc-fed8-44e2-994c-7a2f5dd5f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:57.160282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5eebfc-fed8-44e2-994c-7a2f5dd5f056 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:57.163962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4424fe9-ac03-49fa-a874-252bd685f87f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:57.164688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4424fe9-ac03-49fa-a874-252bd685f87f service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:57.164911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4424fe9-ac03-49fa-a874-252bd685f87f service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:57.165250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4424fe9-ac03-49fa-a874-252bd685f87f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:57.172920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4424fe9-ac03-49fa-a874-252bd685f87f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:57.174400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4424fe9-ac03-49fa-a874-252bd685f87f service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:57.183989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1143/2287] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:23:57.272650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb99ffc-04dd-4931-944c-7a4d498fec56 None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:57.273030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb99ffc-04dd-4931-944c-7a4d498fec56 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:57.273235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb99ffc-04dd-4931-944c-7a4d498fec56 None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:57.274957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1145/2288] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:23:57.282371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3ba2-3976-4dd8-a019-034b1163eafa None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:57.282697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3ba2-3976-4dd8-a019-034b1163eafa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:57.282875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3ba2-3976-4dd8-a019-034b1163eafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:57.304807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3eab3ba2-3976-4dd8-a019-034b1163eafa None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:57.306533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3eab3ba2-3976-4dd8-a019-034b1163eafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:57.317034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1144/2289] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:23:57.335516 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb99ffc-04dd-4931-944c-7a4d498fec56 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:23:57.348320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb99ffc-04dd-4931-944c-7a4d498fec56 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:23:57.352667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11cea3-6d4f-4227-b90b-5e702616a009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:23:57.353735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11cea3-6d4f-4227-b90b-5e702616a009 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:57.354191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11cea3-6d4f-4227-b90b-5e702616a009 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:57.354612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11cea3-6d4f-4227-b90b-5e702616a009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:57.365901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11cea3-6d4f-4227-b90b-5e702616a009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:23:57.367508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11cea3-6d4f-4227-b90b-5e702616a009 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:23:57.379706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1146/2290] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:23:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:23:59.351191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fdbd1-52db-4300-9058-ca4fbcc509ef None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:23:59.351733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fdbd1-52db-4300-9058-ca4fbcc509ef None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:23:59.351733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fdbd1-52db-4300-9058-ca4fbcc509ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:23:59.378421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-764fdbd1-52db-4300-9058-ca4fbcc509ef None None] MFA Rules not processed for user `46c3c63c45ed4882bd7b4b70bea2f613`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:23:59.379717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-764fdbd1-52db-4300-9058-ca4fbcc509ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:23:59.404999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:23:59.436186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1145/2291] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:24:06.949614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b9a16-2c45-4ba5-8dd5-3a87f5f7e6f5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:06.950055 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b9a16-2c45-4ba5-8dd5-3a87f5f7e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:06.950255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b9a16-2c45-4ba5-8dd5-3a87f5f7e6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:06.972968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-383b9a16-2c45-4ba5-8dd5-3a87f5f7e6f5 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:24:06.974234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-383b9a16-2c45-4ba5-8dd5-3a87f5f7e6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:06.983664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1147/2292] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:24:06.998425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fdbd1-52db-4300-9058-ca4fbcc509ef None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:24:07.014652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fdbd1-52db-4300-9058-ca4fbcc509ef None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:24:07.022112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:24:07.023168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:07.023655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:07.024237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:07.036844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:24:07.039094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:24:07.051784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1146/2293] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:24:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 01:24:16.967748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=26 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:17.048799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=18 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:23.655163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:23.656126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:23.656595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:23.678681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:24:23.680299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:23.688734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1148/2294] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 01:24:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:24:23.704443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:24:23.716454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8e3f-b1ad-4be3-8d4c-d10e6787dd19 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:24:23.723216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:24:23.724061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:23.724353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:23.724609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:23.734228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:24:23.735772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:24:23.748754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1147/2295] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:24:25.132815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:24:25.135344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:25.151341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5dfa6-65a3-4e4b-96f2-0996cb369f7a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:24:25.157226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:24:25.158070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:25.158403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:25.158684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] PATH_INFO: `/v3/users/0689cf10e21441568c7298885434eec0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:25.159902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0689cf10e21441568c7298885434eec0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:24:25.162007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:24:25.215004 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0689cf10e21441568c7298885434eec0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.221987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0689cf10e21441568c7298885434eec0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.222673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0689cf10e21441568c7298885434eec0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.243010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0689cf10e21441568c7298885434eec0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.252156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4391b71-210f-441e-b619-32fa4d52075c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0689cf10e21441568c7298885434eec0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.262243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1149/2296] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:24:25 2022] DELETE /identity/v3/users/0689cf10e21441568c7298885434eec0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:24:25.530324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:24:25.541766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3f384-04c8-4ba5-91ae-58a34b376b7d service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:24:25.599213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:24:25.600064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:25.600436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:25.600794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] PATH_INFO: `/v3/projects/36b790b40cde43bcac1bd452968bbeee` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:25.608686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b790b40cde43bcac1bd452968bbeee)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:24:25.610745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:24:25.665275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b790b40cde43bcac1bd452968bbeee', 'request_id': 'req-f5047cbc-980a-4db6-84d5-c7744fabae6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.675833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b790b40cde43bcac1bd452968bbeee', 'request_id': 'req-f5047cbc-980a-4db6-84d5-c7744fabae6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.681519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b790b40cde43bcac1bd452968bbeee', 'request_id': 'req-f5047cbc-980a-4db6-84d5-c7744fabae6a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.692521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] The token cache is being invalidate because project 36b790b40cde43bcac1bd452968bbeee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:24:25.692806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.693506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f5047cbc-980a-4db6-84d5-c7744fabae6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:24:25.695080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1148/2297] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:24:25 2022] DELETE /identity/v3/projects/36b790b40cde43bcac1bd452968bbeee => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:24:35.262921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:35.689376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:24:53.673610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388e5f-22f8-42e0-bb99-379e22ca8457 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:24:53.674294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388e5f-22f8-42e0-bb99-379e22ca8457 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:24:53.674294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e388e5f-22f8-42e0-bb99-379e22ca8457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:24:53.694024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1e388e5f-22f8-42e0-bb99-379e22ca8457 None None] MFA Rules not processed for user `bef2265fc5044f878ba35c90c24a634d`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:24:53.695233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1e388e5f-22f8-42e0-bb99-379e22ca8457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:24:53.753287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1150/2298] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:24:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:03.745488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:08.114239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7df64-a97a-4bc2-a25d-8eb2b06131ae None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:08.114780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7df64-a97a-4bc2-a25d-8eb2b06131ae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:08.114780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7df64-a97a-4bc2-a25d-8eb2b06131ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:08.134846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-a5c7df64-a97a-4bc2-a25d-8eb2b06131ae None None] MFA Rules not processed for user `eef6662134a14362bd6dd6d1a13b2e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:08.136074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a5c7df64-a97a-4bc2-a25d-8eb2b06131ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:08.194746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1149/2299] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:25:14.564375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:14.564896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:14.564896 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:14.583907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] MFA Rules not processed for user `59e0b75ebfd64c5fa2a4dd012c6620be`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:14.585116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:14.640992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1151/2300] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:18.186555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=25 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:24.633056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=25 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:25.941794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:25.942389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:25.942389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:25.967983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] MFA Rules not processed for user `46c3c63c45ed4882bd7b4b70bea2f613`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:25:25.969205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:26.028796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1150/2301] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:25:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:25:35.171396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:35.173177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:35.237713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497314c-a2ea-4107-9340-52d17b1dc41e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:35.242047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:35.242676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:35.242955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:35.243226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:35.245102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:35.316038 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:35.317441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:35.328870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1152/2302] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:36.021553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=25 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:36.883318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:36.885129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:36.950717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc50466-4cdd-4eec-b4fe-7b275ea51277 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:36.954574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:36.955223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:36.955493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:36.955762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:36.957656 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:36.971389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:36.972947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:36.984044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1151/2303] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:45.324052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=54 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:46.979243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=26 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:25:50.867260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:50.880537 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd646d42-17d6-4fe1-94b1-6b633079bd28 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:50.885827 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:50.886467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:50.886743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:50.887012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:50.889009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:50.900774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:50.902253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:50.911465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1153/2304] 10.222.0.17 () {60 vars in 1396 bytes} [Sat Aug 6 01:25:50 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:25:59.225434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:25:59.235959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c7a3f-e2e5-41f1-9ea7-c1e6e3a193c2 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:25:59.243236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:25:59.244207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:25:59.244480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:25:59.244749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:25:59.247106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:25:59.314410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:25:59.315757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:25:59.325986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1152/2305] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:00.907265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:02.479665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:02.481136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:02.496378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac0bbd6-0312-445a-b409-e1e96e276780 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:02.501752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:02.502475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:02.502754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:02.503159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] PATH_INFO: `/v3/users/bef2265fc5044f878ba35c90c24a634d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:02.504467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef2265fc5044f878ba35c90c24a634d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:02.506954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:02.556485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef2265fc5044f878ba35c90c24a634d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.563798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef2265fc5044f878ba35c90c24a634d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.564539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef2265fc5044f878ba35c90c24a634d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.577536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef2265fc5044f878ba35c90c24a634d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.586815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7f6c00a8-46f6-4c60-9ab0-a6beb01ddba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef2265fc5044f878ba35c90c24a634d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.592953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1154/2306] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:02 2022] DELETE /identity/v3/users/bef2265fc5044f878ba35c90c24a634d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:02.782592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:02.793090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a9aa3-e672-4921-b5de-009f147635c5 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:02.854907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:02.855547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:02.855821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:02.856088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] PATH_INFO: `/v3/projects/1b1776d037f94d37a8ed6a95c3303259` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:02.857651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1776d037f94d37a8ed6a95c3303259)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:02.859622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:02.909908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1776d037f94d37a8ed6a95c3303259', 'request_id': 'req-02331e6e-633c-4ba3-9f6d-ed78e410d2df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.919677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1776d037f94d37a8ed6a95c3303259', 'request_id': 'req-02331e6e-633c-4ba3-9f6d-ed78e410d2df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.925090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1776d037f94d37a8ed6a95c3303259', 'request_id': 'req-02331e6e-633c-4ba3-9f6d-ed78e410d2df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.935836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] The token cache is being invalidate because project 1b1776d037f94d37a8ed6a95c3303259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:02.936117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.936770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02331e6e-633c-4ba3-9f6d-ed78e410d2df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:02.938406 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1153/2307] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:02 2022] DELETE /identity/v3/projects/1b1776d037f94d37a8ed6a95c3303259 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:02.943518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba7796-59a5-4146-8850-53a5cfa49113 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:02.943813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba7796-59a5-4146-8850-53a5cfa49113 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:02.944090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba7796-59a5-4146-8850-53a5cfa49113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:02.965797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-61ba7796-59a5-4146-8850-53a5cfa49113 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:02.967027 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61ba7796-59a5-4146-8850-53a5cfa49113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:03.041974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1155/2308] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:03.050177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c84a6f-c2fa-4556-9511-3cfa66cb8cae None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.050468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c84a6f-c2fa-4556-9511-3cfa66cb8cae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.050769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c84a6f-c2fa-4556-9511-3cfa66cb8cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.073752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e3c84a6f-c2fa-4556-9511-3cfa66cb8cae None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:03.075102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e3c84a6f-c2fa-4556-9511-3cfa66cb8cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:03.083498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1154/2309] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:03.087957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba7796-59a5-4146-8850-53a5cfa49113 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.102254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba7796-59a5-4146-8850-53a5cfa49113 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.108142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.108142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.108382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.108489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.109181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:03.109477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.111121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.123044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1156/2310] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:26:03.127524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c84a6f-c2fa-4556-9511-3cfa66cb8cae None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.136859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c84a6f-c2fa-4556-9511-3cfa66cb8cae None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.144548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.145272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.145612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.145998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.146898 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.148921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.171769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:03.186643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1155/2311] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/projects => generated 405 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:03.190940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.201052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396a27-68b4-402d-9565-12578ccbe098 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.257256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.257805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.258124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.258398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.259061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.261028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.269019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:03.284110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1157/2312] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:03.288351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.298917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621d9fb-e8bf-4dae-9500-2ce68b4d6a0c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.304033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.304648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.304927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.305188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.305888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.307515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.317692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1156/2313] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:03.321893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.331902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644b8e7-1ea6-448c-95dc-7c7663ce7837 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.337119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b77ce4-1cb5-4035-bbfb-d4d35f271220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.337805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b77ce4-1cb5-4035-bbfb-d4d35f271220 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.338146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b77ce4-1cb5-4035-bbfb-d4d35f271220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.338423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b77ce4-1cb5-4035-bbfb-d4d35f271220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.339136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b77ce4-1cb5-4035-bbfb-d4d35f271220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.340779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b77ce4-1cb5-4035-bbfb-d4d35f271220 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.352257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1158/2314] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:03.357966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.373518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb0c2a-0a54-459f-b187-8667574c7a05 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.382590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.383439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.383785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.384148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] PATH_INFO: `/v3/projects/d53750170dfa4b88a7d7204b19a4b49c/users/a409c2a2b1b44fffbf5caa11d165d39e/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.399813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53750170dfa4b88a7d7204b19a4b49c, user_id=a409c2a2b1b44fffbf5caa11d165d39e, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.402632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.417346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1157/2315] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:03 2022] PUT /identity/v3/projects/d53750170dfa4b88a7d7204b19a4b49c/users/a409c2a2b1b44fffbf5caa11d165d39e/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:03.427886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eead21-03c0-4590-a321-2d911859acac None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.428176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eead21-03c0-4590-a321-2d911859acac None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.428433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eead21-03c0-4590-a321-2d911859acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.457222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-89eead21-03c0-4590-a321-2d911859acac None None] MFA Rules not processed for user `a409c2a2b1b44fffbf5caa11d165d39e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:03.458507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-89eead21-03c0-4590-a321-2d911859acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:03.529969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1159/2316] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:03.534900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.600484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715f3ec-e373-49da-8e6a-1f569a4ceef0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.606517 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.607537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.607812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.608090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.608768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.610728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.640917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1158/2317] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:03.645154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eead21-03c0-4590-a321-2d911859acac None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.656149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eead21-03c0-4590-a321-2d911859acac None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.711625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.712333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.712603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.712871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.713526 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.715494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.738781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1160/2318] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/users => generated 308 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:03.743230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.754214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0ab6a-5af5-4c9f-b4a1-bd332b2a7ccc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.759200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.759819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.760099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.760368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.761061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.762677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.773034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1159/2319] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:03.777278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.787290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de33f7-6c11-476b-b12c-03130bb34c90 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.792031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.792664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.792941 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.793210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] PATH_INFO: `/v3/projects/57039459eed34116b51242411ef1e828/users/de373e578b7d42ebb8d0fa049d898c0a/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.808816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57039459eed34116b51242411ef1e828, user_id=de373e578b7d42ebb8d0fa049d898c0a, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.811652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.826387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1161/2320] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:03 2022] PUT /identity/v3/projects/57039459eed34116b51242411ef1e828/users/de373e578b7d42ebb8d0fa049d898c0a/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:03.830313 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.840590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7e766-f0eb-4171-b7a7-39fc4981bb23 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.901582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604aa2a-667f-4b96-874b-0c71ac1c6869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.902231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604aa2a-667f-4b96-874b-0c71ac1c6869 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.902501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604aa2a-667f-4b96-874b-0c71ac1c6869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.902770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604aa2a-667f-4b96-874b-0c71ac1c6869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.903456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604aa2a-667f-4b96-874b-0c71ac1c6869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.905052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604aa2a-667f-4b96-874b-0c71ac1c6869 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.914848 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1160/2321] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:03.919135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:03.929503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e075912e-9c40-43f5-8990-a17a24126c80 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:03.934351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:03.935034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.935311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.935583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] PATH_INFO: `/v3/projects/57039459eed34116b51242411ef1e828/users/de373e578b7d42ebb8d0fa049d898c0a/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.937599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57039459eed34116b51242411ef1e828, user_id=de373e578b7d42ebb8d0fa049d898c0a, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:03.940277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:03.951141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1162/2322] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:03 2022] PUT /identity/v3/projects/57039459eed34116b51242411ef1e828/users/de373e578b7d42ebb8d0fa049d898c0a/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:03.962709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58ed68-9090-4c3c-83ac-040276bbd2b1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:03.962993 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58ed68-9090-4c3c-83ac-040276bbd2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:03.963298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58ed68-9090-4c3c-83ac-040276bbd2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:03.993752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9f58ed68-9090-4c3c-83ac-040276bbd2b1 None None] MFA Rules not processed for user `de373e578b7d42ebb8d0fa049d898c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:03.995083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9f58ed68-9090-4c3c-83ac-040276bbd2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:04.014927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:04.067162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1161/2323] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:04.078097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:04.079994 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:04.102242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:04.137889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c27e20-c168-4874-addc-b39c1ad399b9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:04.141705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c556fd7-ffb4-4059-a0d3-22c7719b8b5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:04.142452 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556fd7-ffb4-4059-a0d3-22c7719b8b5b service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:04.142734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556fd7-ffb4-4059-a0d3-22c7719b8b5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:04.142998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c556fd7-ffb4-4059-a0d3-22c7719b8b5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:04.152263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c556fd7-ffb4-4059-a0d3-22c7719b8b5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:04.153748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c556fd7-ffb4-4059-a0d3-22c7719b8b5b service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:04.163652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1163/2324] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:04.318365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58ed68-9090-4c3c-83ac-040276bbd2b1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:04.392895 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58ed68-9090-4c3c-83ac-040276bbd2b1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:04.398056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:04.398704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:04.398976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:04.399245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] PATH_INFO: `/v3/users/a409c2a2b1b44fffbf5caa11d165d39e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:04.400568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a409c2a2b1b44fffbf5caa11d165d39e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:04.402536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:04.459645 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a409c2a2b1b44fffbf5caa11d165d39e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:04.469382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a409c2a2b1b44fffbf5caa11d165d39e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:04.483240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a409c2a2b1b44fffbf5caa11d165d39e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:04.483913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a409c2a2b1b44fffbf5caa11d165d39e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:04.490846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a409c2a2b1b44fffbf5caa11d165d39e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:04.497292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1162/2325] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:04 2022] DELETE /identity/v3/users/a409c2a2b1b44fffbf5caa11d165d39e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:04.502380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:04.502742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:04.503100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:04.522405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:04.523616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:04.582949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1164/2326] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:04.593561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:04.595259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:04.643428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:04.661407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a064e-eaa1-47d6-8574-5dff68c742d2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:04.665012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:04.665636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:04.665916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:04.666216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:04.675143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:04.676574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:04.686100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1163/2327] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:04.962864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:04.964380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:04.977660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62264d-4156-45df-b2cc-0b2ae7975c13 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:04.984018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:04.984680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:04.984983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:04.985236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] PATH_INFO: `/v3/projects/d53750170dfa4b88a7d7204b19a4b49c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:04.986445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53750170dfa4b88a7d7204b19a4b49c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:04.988375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:05.039319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53750170dfa4b88a7d7204b19a4b49c', 'request_id': 'req-6c539ef2-b302-40fb-a747-006c9d01d333'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.048690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53750170dfa4b88a7d7204b19a4b49c', 'request_id': 'req-6c539ef2-b302-40fb-a747-006c9d01d333'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.055086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53750170dfa4b88a7d7204b19a4b49c', 'request_id': 'req-6c539ef2-b302-40fb-a747-006c9d01d333'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.066876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] The token cache is being invalidate because project d53750170dfa4b88a7d7204b19a4b49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:05.067164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.067881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.069458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1165/2328] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:04 2022] DELETE /identity/v3/projects/d53750170dfa4b88a7d7204b19a4b49c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:05.073680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:05.083607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c0c36-9669-4906-81fd-c87945607509 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:05.144870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:05.145424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:05.145731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:05.146035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] PATH_INFO: `/v3/users/de373e578b7d42ebb8d0fa049d898c0a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:05.147254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de373e578b7d42ebb8d0fa049d898c0a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:05.149170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:05.196578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de373e578b7d42ebb8d0fa049d898c0a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.204869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de373e578b7d42ebb8d0fa049d898c0a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.216489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de373e578b7d42ebb8d0fa049d898c0a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.217110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de373e578b7d42ebb8d0fa049d898c0a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.224174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b333721b-b264-467e-8f67-5e2ccfe9d32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de373e578b7d42ebb8d0fa049d898c0a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.230063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1164/2329] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:05 2022] DELETE /identity/v3/users/de373e578b7d42ebb8d0fa049d898c0a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:05.524367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:05.525906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:05.539543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539ef2-b302-40fb-a747-006c9d01d333 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:05.585097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:05.599759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:05.600434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:05.600706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:05.601009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] PATH_INFO: `/v3/projects/57039459eed34116b51242411ef1e828` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:05.602384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=57039459eed34116b51242411ef1e828)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:05.604410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:05.655959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57039459eed34116b51242411ef1e828', 'request_id': 'req-534311d7-7042-42cc-b315-00569b46f64d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.664183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57039459eed34116b51242411ef1e828', 'request_id': 'req-534311d7-7042-42cc-b315-00569b46f64d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.669763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57039459eed34116b51242411ef1e828', 'request_id': 'req-534311d7-7042-42cc-b315-00569b46f64d'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.681184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] The token cache is being invalidate because project 57039459eed34116b51242411ef1e828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:05.681473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.682215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-534311d7-7042-42cc-b315-00569b46f64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:05.683846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1166/2330] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:05 2022] DELETE /identity/v3/projects/57039459eed34116b51242411ef1e828 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:05.688864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1a5f-0ca4-4871-838c-069c43df1121 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:05.689152 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1a5f-0ca4-4871-838c-069c43df1121 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:05.689427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf1a5f-0ca4-4871-838c-069c43df1121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:05.709572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f3bf1a5f-0ca4-4871-838c-069c43df1121 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:05.710734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3bf1a5f-0ca4-4871-838c-069c43df1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:05.765494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:05.781983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1165/2331] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:05.787713 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fa5b4-994b-45eb-8ded-deb39e545c9b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:05.788006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fa5b4-994b-45eb-8ded-deb39e545c9b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:05.788285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fa5b4-994b-45eb-8ded-deb39e545c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:05.809069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ff8fa5b4-994b-45eb-8ded-deb39e545c9b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:05.810341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff8fa5b4-994b-45eb-8ded-deb39e545c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:05.819015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1167/2332] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:05.823458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1a5f-0ca4-4871-838c-069c43df1121 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:05.833786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf1a5f-0ca4-4871-838c-069c43df1121 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:05.838394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:05.839024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:05.839292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:05.839566 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:05.840265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:05.840569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:05.842206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:05.854452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1166/2333] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:05.859179 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fa5b4-994b-45eb-8ded-deb39e545c9b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:05.868851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fa5b4-994b-45eb-8ded-deb39e545c9b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:05.873528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:05.874174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:05.874456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:05.874722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:05.875410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:05.877379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:05.906519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1168/2334] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:05 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:26:05.911020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:05.921216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73e3c0-ee90-4133-951a-0a9e0176f9db admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:05.978608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:05.979166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:05.979511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:05.979791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:05.980465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:05.982822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.007773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1167/2335] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:05 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:06.009303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.020887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ec4ca-6693-4b81-97be-df08b3a90e63 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.025618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.026288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.026565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.026831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.027535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.029152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.039776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1169/2336] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:06.044029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.054392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e128eb-a34d-4cbb-b397-4ccf86ed56a7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.059361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e131e-f985-4e06-912f-5631c872d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.059981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e131e-f985-4e06-912f-5631c872d767 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.060263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e131e-f985-4e06-912f-5631c872d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.060549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e131e-f985-4e06-912f-5631c872d767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.061240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e131e-f985-4e06-912f-5631c872d767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.062883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364e131e-f985-4e06-912f-5631c872d767 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.072801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1168/2337] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:06.077412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.088140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dda696-bf35-44f7-9acc-bc63f6d82573 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.093998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.094673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.094957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.095227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] PATH_INFO: `/v3/projects/f17bd9ae7a904cd797861f5f38bfe2fd/users/24ba7107c8c34e74bc0f384e34155e30/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.110904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17bd9ae7a904cd797861f5f38bfe2fd, user_id=24ba7107c8c34e74bc0f384e34155e30, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.113603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.128567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1170/2338] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:06 2022] PUT /identity/v3/projects/f17bd9ae7a904cd797861f5f38bfe2fd/users/24ba7107c8c34e74bc0f384e34155e30/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:06.140366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272139-f9a5-4a66-b921-317dc1a11bad None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.140881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272139-f9a5-4a66-b921-317dc1a11bad None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.140974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6272139-f9a5-4a66-b921-317dc1a11bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.170232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f6272139-f9a5-4a66-b921-317dc1a11bad None None] MFA Rules not processed for user `24ba7107c8c34e74bc0f384e34155e30`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:06.171481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f6272139-f9a5-4a66-b921-317dc1a11bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.239765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1169/2339] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:06.245560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.307695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c79c-e700-4044-8217-b9c0bd52899a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.312612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.313230 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.313511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.313784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.314480 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.316425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.338211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:06.347156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1171/2340] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:06 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:06.351325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272139-f9a5-4a66-b921-317dc1a11bad None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.363260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6272139-f9a5-4a66-b921-317dc1a11bad None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.411008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:06.421231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.421864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.422189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.422467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.423136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.425093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.447854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1170/2341] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:06 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:26:06.451980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.462523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33f4b3-4d0c-46e4-821d-510ae03b8195 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.467893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.468510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.468790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.469084 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.469783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.471420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.485711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1172/2342] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:06.487634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.488105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.490113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.498621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f744d4b-e0dd-437e-ae15-d6da0a12a0f6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.504213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.505107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.505612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.505849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] PATH_INFO: `/v3/projects/b45036f5fae74fcbb7b699a91d038ad5/users/494adf018fc54d9583c4a6efacc7244b/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.522609 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45036f5fae74fcbb7b699a91d038ad5, user_id=494adf018fc54d9583c4a6efacc7244b, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.525354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.538705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1171/2343] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:06 2022] PUT /identity/v3/projects/b45036f5fae74fcbb7b699a91d038ad5/users/494adf018fc54d9583c4a6efacc7244b/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:06.542784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.572326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a68fb-8028-4161-afb5-b25adffb17bc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.608661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219eaee9-669e-40f4-a296-48042ad7dd55 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.613460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.614134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.614410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.614685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.615385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.617003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.626946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1172/2344] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:06.631012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.638485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.639119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.639398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.639676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.640475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a8e18-5d65-4712-9a83-cf583a9c3e86 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.641638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.645067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b03f9f-8308-4214-ab70-ff8d28394e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.645710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03f9f-8308-4214-ab70-ff8d28394e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.646024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03f9f-8308-4214-ab70-ff8d28394e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.646302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03f9f-8308-4214-ab70-ff8d28394e56 admin admin] PATH_INFO: `/v3/projects/b45036f5fae74fcbb7b699a91d038ad5/users/494adf018fc54d9583c4a6efacc7244b/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.648243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b03f9f-8308-4214-ab70-ff8d28394e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45036f5fae74fcbb7b699a91d038ad5, user_id=494adf018fc54d9583c4a6efacc7244b, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.650991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b03f9f-8308-4214-ab70-ff8d28394e56 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.661381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1173/2345] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:06 2022] PUT /identity/v3/projects/b45036f5fae74fcbb7b699a91d038ad5/users/494adf018fc54d9583c4a6efacc7244b/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:06.671680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817f787-b973-4617-ba59-36dcb0effeb6 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.671969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817f787-b973-4617-ba59-36dcb0effeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.672247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817f787-b973-4617-ba59-36dcb0effeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.699843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7817f787-b973-4617-ba59-36dcb0effeb6 None None] MFA Rules not processed for user `494adf018fc54d9583c4a6efacc7244b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:06.701073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7817f787-b973-4617-ba59-36dcb0effeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.707045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.708675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.717767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1173/2346] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:06.772730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1174/2347] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:06.784465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.786041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:06.812767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:06.844640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a2c16-e172-449f-b2a3-b0bd449a1307 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:06.896317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090de8ef-f957-4515-9218-feb32581bec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:06.897037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090de8ef-f957-4515-9218-feb32581bec7 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:06.897300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090de8ef-f957-4515-9218-feb32581bec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:06.897569 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090de8ef-f957-4515-9218-feb32581bec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:06.907783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090de8ef-f957-4515-9218-feb32581bec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:06.909284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090de8ef-f957-4515-9218-feb32581bec7 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:06.919299 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1174/2348] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:06.955672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817f787-b973-4617-ba59-36dcb0effeb6 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:06.990889 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:07.036070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817f787-b973-4617-ba59-36dcb0effeb6 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:07.042106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:07.042768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:07.043043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:07.043306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] PATH_INFO: `/v3/users/24ba7107c8c34e74bc0f384e34155e30` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:07.044506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ba7107c8c34e74bc0f384e34155e30)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:07.046495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:07.095006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ba7107c8c34e74bc0f384e34155e30'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.102441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ba7107c8c34e74bc0f384e34155e30'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.114567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ba7107c8c34e74bc0f384e34155e30'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.115211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ba7107c8c34e74bc0f384e34155e30'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.121840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ba7107c8c34e74bc0f384e34155e30'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.127866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1175/2349] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:06 2022] DELETE /identity/v3/users/24ba7107c8c34e74bc0f384e34155e30 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:07.132404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:07.132687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:07.132957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:07.151500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:07.152695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:07.212209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1175/2350] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:07.222123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:07.223750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:07.285388 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76246abb-3ccf-4da8-ab2d-f7b4f22b0d89 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:07.289603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:07.290326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:07.290602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:07.290867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:07.302173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:07.303611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:07.313455 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1176/2351] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:07.592048 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:07.593852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:07.608580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416778d-a215-4be4-b892-aa6c84201013 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:07.615124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:07.615800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:07.616108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:07.616444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] PATH_INFO: `/v3/projects/f17bd9ae7a904cd797861f5f38bfe2fd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:07.617540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17bd9ae7a904cd797861f5f38bfe2fd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:07.619697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:07.668598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17bd9ae7a904cd797861f5f38bfe2fd', 'request_id': 'req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.677622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17bd9ae7a904cd797861f5f38bfe2fd', 'request_id': 'req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.683447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17bd9ae7a904cd797861f5f38bfe2fd', 'request_id': 'req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.694744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] The token cache is being invalidate because project f17bd9ae7a904cd797861f5f38bfe2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:07.695031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.695744 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.697352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1176/2352] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:07 2022] DELETE /identity/v3/projects/f17bd9ae7a904cd797861f5f38bfe2fd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:07.701452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:07.711494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208033d-2db2-43f7-a3fa-e91453472aec service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:07.759565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:07.772946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:07.773592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:07.773868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:07.774171 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] PATH_INFO: `/v3/users/494adf018fc54d9583c4a6efacc7244b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:07.775489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=494adf018fc54d9583c4a6efacc7244b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:07.777438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:07.832565 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '494adf018fc54d9583c4a6efacc7244b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.840712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '494adf018fc54d9583c4a6efacc7244b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.853486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '494adf018fc54d9583c4a6efacc7244b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.854168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '494adf018fc54d9583c4a6efacc7244b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.861457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-28340783-070c-4ef3-9bb1-fdaa327f6e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '494adf018fc54d9583c4a6efacc7244b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:07.867612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1177/2353] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:07 2022] DELETE /identity/v3/users/494adf018fc54d9583c4a6efacc7244b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:08.148316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:08.150056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:08.160880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:08.166730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1285aa-3c53-495a-b02c-d8ff93ad36fe admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:08.230070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:08.230730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.231108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.231384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] PATH_INFO: `/v3/projects/b45036f5fae74fcbb7b699a91d038ad5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.232933 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45036f5fae74fcbb7b699a91d038ad5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:08.234913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:08.284620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45036f5fae74fcbb7b699a91d038ad5', 'request_id': 'req-b474861b-6f86-4e27-b61d-5024b462990b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:08.293276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45036f5fae74fcbb7b699a91d038ad5', 'request_id': 'req-b474861b-6f86-4e27-b61d-5024b462990b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:08.299475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45036f5fae74fcbb7b699a91d038ad5', 'request_id': 'req-b474861b-6f86-4e27-b61d-5024b462990b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:08.311017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] The token cache is being invalidate because project b45036f5fae74fcbb7b699a91d038ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:08.311377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:08.312111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-b474861b-6f86-4e27-b61d-5024b462990b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:08.314012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1177/2354] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:08 2022] DELETE /identity/v3/projects/b45036f5fae74fcbb7b699a91d038ad5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:08.320346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c51c-5e77-46c3-9c94-776eceef4a1e None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.320866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c51c-5e77-46c3-9c94-776eceef4a1e None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.320991 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3c51c-5e77-46c3-9c94-776eceef4a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.344563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-77c3c51c-5e77-46c3-9c94-776eceef4a1e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:08.345915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-77c3c51c-5e77-46c3-9c94-776eceef4a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:08.411199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1178/2355] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:08.421307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde8e0-cde8-4336-8167-73aedf6edd51 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.421603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde8e0-cde8-4336-8167-73aedf6edd51 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.421882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cde8e0-cde8-4336-8167-73aedf6edd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.442318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-40cde8e0-cde8-4336-8167-73aedf6edd51 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:08.443607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-40cde8e0-cde8-4336-8167-73aedf6edd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:08.452088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1178/2356] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:08.464903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c51c-5e77-46c3-9c94-776eceef4a1e None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:08.474888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3c51c-5e77-46c3-9c94-776eceef4a1e None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:08.479904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:08.480520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.480791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.481088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.482202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:08.482596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:08.484229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:08.496359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1179/2357] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:08.501197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cde8e0-cde8-4336-8167-73aedf6edd51 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:08.511541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cde8e0-cde8-4336-8167-73aedf6edd51 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:08.516591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:08.517245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.517521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.517789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.518492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:08.520476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:08.549667 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1179/2358] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:08 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:08.553869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:08.564127 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb347934-a6a1-46ac-8737-71d90f2d5bde admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:08.745765 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:08.753486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:08.754167 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.754787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.755062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.755794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:08.758135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:08.783682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1180/2359] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:08 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:08.787957 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:08.798598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad590469-f905-4224-91e1-679e73fde5f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:08.803300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:08.803916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.804199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.804473 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.805183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:08.806850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:08.817645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1180/2360] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:08.820864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:08.831847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c8da1-3f4c-42c7-b0b7-610ab6236b46 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:08.837740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869194d-3496-4d4d-b913-04326615a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:08.838358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869194d-3496-4d4d-b913-04326615a1df admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.838634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869194d-3496-4d4d-b913-04326615a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.838899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869194d-3496-4d4d-b913-04326615a1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.839598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869194d-3496-4d4d-b913-04326615a1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:08.841208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869194d-3496-4d4d-b913-04326615a1df admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:08.851791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1181/2361] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:26:08.856385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:08.871865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71212a2b-1dbc-4cad-8972-c50a42d1328e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:08.878191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:08.878862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.879143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.879416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] PATH_INFO: `/v3/projects/e706eea94fbb4564bf5cd733953a7aea/users/5678a7212c8741e69abced536fb6226f/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.895376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e706eea94fbb4564bf5cd733953a7aea, user_id=5678a7212c8741e69abced536fb6226f, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:08.898075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:08.917139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1181/2362] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:08 2022] PUT /identity/v3/projects/e706eea94fbb4564bf5cd733953a7aea/users/5678a7212c8741e69abced536fb6226f/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:08.928669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd78664-1fa3-4732-a680-5c9994a30ec0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:08.928929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd78664-1fa3-4732-a680-5c9994a30ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:08.929201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd78664-1fa3-4732-a680-5c9994a30ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:08.958580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8cd78664-1fa3-4732-a680-5c9994a30ec0 None None] MFA Rules not processed for user `5678a7212c8741e69abced536fb6226f`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:08.959805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8cd78664-1fa3-4732-a680-5c9994a30ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:09.023276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1182/2363] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:09.027874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.060355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:09.090628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fd868-68bc-4443-987d-9ca67b59586c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.096106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.096752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.097013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.097283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.097975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.099904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.129728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1182/2364] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:09 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:09.135598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd78664-1fa3-4732-a680-5c9994a30ec0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.147506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd78664-1fa3-4732-a680-5c9994a30ec0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.214843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.215495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.215768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.216027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.216685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.218628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.241482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1183/2365] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:09 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:09.246504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.257300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abab8e9-1e79-4482-a714-39bc863819ff admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.263226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.264417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.264696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.264952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.265650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.267314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.278375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1183/2366] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:09.282857 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.295681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316972a-9008-4534-b13d-2335994df1de admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.301163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.301827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.302157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.302427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] PATH_INFO: `/v3/projects/63ed88fda960483098ab856429960afa/users/59359b17243a47638a306146c4c5a30e/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.317526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ed88fda960483098ab856429960afa, user_id=59359b17243a47638a306146c4c5a30e, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.320222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.335338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1184/2367] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:09 2022] PUT /identity/v3/projects/63ed88fda960483098ab856429960afa/users/59359b17243a47638a306146c4c5a30e/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:09.339438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.350497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be48f3-0795-4ca8-8892-830ede3bcf67 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.409429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e8edb-8b7a-4bbf-a64b-ba105d40c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.410151 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8edb-8b7a-4bbf-a64b-ba105d40c907 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.410434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8edb-8b7a-4bbf-a64b-ba105d40c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.410707 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e8edb-8b7a-4bbf-a64b-ba105d40c907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.411401 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e8edb-8b7a-4bbf-a64b-ba105d40c907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.413022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e8edb-8b7a-4bbf-a64b-ba105d40c907 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.423113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1184/2368] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:09.427399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.438249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a9fa7-7fc3-4e7d-bc86-702acd92b63b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.443347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.444018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.444300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.444568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] PATH_INFO: `/v3/projects/63ed88fda960483098ab856429960afa/users/59359b17243a47638a306146c4c5a30e/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.446726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ed88fda960483098ab856429960afa, user_id=59359b17243a47638a306146c4c5a30e, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.449511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.460009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1185/2369] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:09 2022] PUT /identity/v3/projects/63ed88fda960483098ab856429960afa/users/59359b17243a47638a306146c4c5a30e/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:09.470424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3011-8f89-471f-9774-00415ce5e526 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.470786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3011-8f89-471f-9774-00415ce5e526 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.471168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3011-8f89-471f-9774-00415ce5e526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.502586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-04db3011-8f89-471f-9774-00415ce5e526 None None] MFA Rules not processed for user `59359b17243a47638a306146c4c5a30e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:09.503859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-04db3011-8f89-471f-9774-00415ce5e526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:09.579900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1185/2370] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:09.592801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:09.594999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:09.627964 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:09.668568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922c773-d12f-4c78-948e-4770bc2bc0dc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:09.672272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:09.672909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:09.673186 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:09.673456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:09.682982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:09.684444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:09.694240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1186/2371] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:10.023446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3011-8f89-471f-9774-00415ce5e526 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:10.033137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3011-8f89-471f-9774-00415ce5e526 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:10.038493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59359b17243a47638a306146c4c5a30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ed88fda960483098ab856429960afa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:10.039136 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:10.039424 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:10.039715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:10.040493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:10.040792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:10.042461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:10.054822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1186/2372] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:10.059282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:10.069002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa8be1-b9f9-4463-acde-266b993e48c4 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:10.074534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59359b17243a47638a306146c4c5a30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ed88fda960483098ab856429960afa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:10.075149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:10.075429 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:10.075703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:10.076366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:10.078301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:10.108583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1187/2373] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:10 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:10.112791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:10.123453 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d1aef-4e76-4354-b2a3-d0217ad673f1 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:10.132985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:10.182955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59359b17243a47638a306146c4c5a30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ed88fda960483098ab856429960afa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:10.183572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:10.183857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:10.184133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:10.184831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:10.185126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:10.186795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:10.198574 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1187/2374] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:10.235620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:10.246293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb17e8-a110-46c9-b936-675849c82efc tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:10.251415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '59359b17243a47638a306146c4c5a30e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63ed88fda960483098ab856429960afa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:10.252058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:10.252339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:10.252632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] PATH_INFO: `/v3/projects/4d84e94b2264420db5a4969a3c68d348` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:10.253831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4d84e94b2264420db5a4969a3c68d348)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:10.255788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:10.306198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d84e94b2264420db5a4969a3c68d348', 'request_id': 'req-c7084489-790b-44d5-a56d-d03181020322'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.314598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d84e94b2264420db5a4969a3c68d348', 'request_id': 'req-c7084489-790b-44d5-a56d-d03181020322'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.320327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d84e94b2264420db5a4969a3c68d348', 'request_id': 'req-c7084489-790b-44d5-a56d-d03181020322'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.332108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] The token cache is being invalidate because project 4d84e94b2264420db5a4969a3c68d348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:10.332395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.333073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c7084489-790b-44d5-a56d-d03181020322 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.334634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1188/2375] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:10 2022] DELETE /identity/v3/projects/4d84e94b2264420db5a4969a3c68d348 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:10.536810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:10.538614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:10.605905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77a0a9-dc30-4d04-bf9f-be06f165bea8 tempest-VolumeQuotaClassesTest-1722815176 tempest-VolumeQuotaClassesTest-1722815176-project-admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:10.664066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:10.664790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:10.665033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:10.665598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] PATH_INFO: `/v3/users/5678a7212c8741e69abced536fb6226f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:10.667123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5678a7212c8741e69abced536fb6226f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:10.669093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:10.721619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5678a7212c8741e69abced536fb6226f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.728752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5678a7212c8741e69abced536fb6226f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.729426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5678a7212c8741e69abced536fb6226f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.730626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:10.743999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5678a7212c8741e69abced536fb6226f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.753111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5678a7212c8741e69abced536fb6226f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:10.759760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1188/2376] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:10 2022] DELETE /identity/v3/users/5678a7212c8741e69abced536fb6226f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:10.764494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:10.764984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:10.765081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:10.783295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:10.784506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:10.848483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1189/2377] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:10.855441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:10.857328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:10.915396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba4779-3de0-4491-bb45-76ef7d19d330 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:10.919551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:10.920180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:10.920462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:10.920732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:10.930524 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:10.932011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:10.941854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1189/2378] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:11.217633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:11.219197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:11.232098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc5583-f7e7-4024-8b62-7aba41cb5cde None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:11.237728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:11.238718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:11.239064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:11.239340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] PATH_INFO: `/v3/projects/e706eea94fbb4564bf5cd733953a7aea` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:11.240627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e706eea94fbb4564bf5cd733953a7aea)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:11.242611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:11.260206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:11.295004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e706eea94fbb4564bf5cd733953a7aea', 'request_id': 'req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.303755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e706eea94fbb4564bf5cd733953a7aea', 'request_id': 'req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.310574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e706eea94fbb4564bf5cd733953a7aea', 'request_id': 'req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.322967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] The token cache is being invalidate because project e706eea94fbb4564bf5cd733953a7aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:11.323288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.324141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.326673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1190/2379] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:11 2022] DELETE /identity/v3/projects/e706eea94fbb4564bf5cd733953a7aea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:11.331442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:11.341597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6bf78-ebf2-4071-8257-019591c02eda service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:11.401448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:11.402124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:11.402413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:11.402682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] PATH_INFO: `/v3/users/59359b17243a47638a306146c4c5a30e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:11.403875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] RBAC: Authorizing `identity:delete_user(user_id=59359b17243a47638a306146c4c5a30e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:11.405815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:11.458497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59359b17243a47638a306146c4c5a30e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.465729 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59359b17243a47638a306146c4c5a30e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.466495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59359b17243a47638a306146c4c5a30e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.479288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59359b17243a47638a306146c4c5a30e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.483245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:11.489349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-efa3fe38-d5d1-4e6a-b797-8091969b25db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59359b17243a47638a306146c4c5a30e'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.499899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1190/2380] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:11 2022] DELETE /identity/v3/users/59359b17243a47638a306146c4c5a30e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:11.801169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:11.802828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:11.825223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02068d29-f4b9-45b1-8dc6-f25c0fc5276f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:11.882612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:11.883259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:11.883538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:11.883910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] PATH_INFO: `/v3/projects/63ed88fda960483098ab856429960afa` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:11.885201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ed88fda960483098ab856429960afa)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:11.887170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:11.934745 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ed88fda960483098ab856429960afa', 'request_id': 'req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.943768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ed88fda960483098ab856429960afa', 'request_id': 'req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.949823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ed88fda960483098ab856429960afa', 'request_id': 'req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.961404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] The token cache is being invalidate because project 63ed88fda960483098ab856429960afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:11.961684 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.962501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-543e5aaa-4944-4b6b-a05d-a9f5e69aaaaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:11.964100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1191/2381] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:11 2022] DELETE /identity/v3/projects/63ed88fda960483098ab856429960afa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:11.969181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad4269-7ef8-42c2-884f-068d04ce2fdb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:11.969564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad4269-7ef8-42c2-884f-068d04ce2fdb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:11.969846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad4269-7ef8-42c2-884f-068d04ce2fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:11.990482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ebad4269-7ef8-42c2-884f-068d04ce2fdb None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:11.991685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ebad4269-7ef8-42c2-884f-068d04ce2fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:12.052533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1191/2382] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:12.060691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475127-1909-4591-b431-6c84f5629473 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.060979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475127-1909-4591-b431-6c84f5629473 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.061252 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76475127-1909-4591-b431-6c84f5629473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.081235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-76475127-1909-4591-b431-6c84f5629473 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:12.082483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-76475127-1909-4591-b431-6c84f5629473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:12.091081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1192/2383] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:12.095463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad4269-7ef8-42c2-884f-068d04ce2fdb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.107273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad4269-7ef8-42c2-884f-068d04ce2fdb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.112421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.113057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.113336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.113614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.114326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:12.114631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.116251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.128845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1192/2384] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:12.133307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76475127-1909-4591-b431-6c84f5629473 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.142995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76475127-1909-4591-b431-6c84f5629473 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.148152 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.148766 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.149038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.149354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.150099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.151985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.180131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1193/2385] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:12 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:12.184811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.195014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2584-364a-4356-aea8-5cc99621c11f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.252881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.253478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.253759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.254067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.254739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.256702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.282014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1193/2386] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:12 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:12.283192 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.290042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:12.294248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d62a33-fa01-41a7-a7be-65b0cc32338b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.300508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.301199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.301478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.301774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.302525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.304507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.318459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1194/2387] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:12.322760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.337467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef3556-9f28-46d8-93de-b6b072d65eba admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.343062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf436197-453c-453a-b867-8f26266bec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.343824 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf436197-453c-453a-b867-8f26266bec9e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.344114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf436197-453c-453a-b867-8f26266bec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.344378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf436197-453c-453a-b867-8f26266bec9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.345076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf436197-453c-453a-b867-8f26266bec9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.346734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf436197-453c-453a-b867-8f26266bec9e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.361968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1194/2388] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:26:12.365563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.376798 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3c403-dc86-49d5-9092-2725644de0dc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.381550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.382277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.382556 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.382835 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] PATH_INFO: `/v3/projects/6dd7db2d523d4da89e06cdd37bb432b1/users/6d563be01ec34928a560653bad749264/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.400350 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd7db2d523d4da89e06cdd37bb432b1, user_id=6d563be01ec34928a560653bad749264, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.404022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.419200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1195/2389] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:12 2022] PUT /identity/v3/projects/6dd7db2d523d4da89e06cdd37bb432b1/users/6d563be01ec34928a560653bad749264/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:12.430655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616007-cae0-401e-b885-2b7054621a9d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.430972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616007-cae0-401e-b885-2b7054621a9d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.431238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd616007-cae0-401e-b885-2b7054621a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.462964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd616007-cae0-401e-b885-2b7054621a9d None None] MFA Rules not processed for user `6d563be01ec34928a560653bad749264`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:12.464194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd616007-cae0-401e-b885-2b7054621a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:12.516255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:12.534117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1195/2390] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:12.538819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.600336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19342-5221-4110-84b9-0e5368ff5f35 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.605298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.605916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.606217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.606484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.607503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.609390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.635661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1196/2391] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:12 2022] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:12.639972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616007-cae0-401e-b885-2b7054621a9d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.650746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd616007-cae0-401e-b885-2b7054621a9d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.707600 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.708318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.708564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.708840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.709512 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.711568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.733382 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1196/2392] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:12 2022] POST /identity/v3/users => generated 302 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:26:12.737641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.748250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f6740-02d7-4983-8c38-256a019e0991 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.753788 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.754444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.754728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.755000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.755700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.757323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.768314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1197/2393] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:12.772755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.784210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2901-b09c-4729-9c2b-2dd58d975555 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.790701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.791492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.791755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.792102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] PATH_INFO: `/v3/projects/b5f4e38bf235476dbe29d8bb8fabb670/users/bf6e001f477b411c971ff087d1dfada2/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.808576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f4e38bf235476dbe29d8bb8fabb670, user_id=bf6e001f477b411c971ff087d1dfada2, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.811303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.825784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1197/2394] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:12 2022] PUT /identity/v3/projects/b5f4e38bf235476dbe29d8bb8fabb670/users/bf6e001f477b411c971ff087d1dfada2/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:12.830197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.840709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b0e23-9cc4-48e0-97fb-a48b5e245d90 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.902341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce85e8-f1db-449d-a019-d37353f58e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.902984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce85e8-f1db-449d-a019-d37353f58e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.903260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce85e8-f1db-449d-a019-d37353f58e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.903523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce85e8-f1db-449d-a019-d37353f58e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.904227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce85e8-f1db-449d-a019-d37353f58e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.905834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce85e8-f1db-449d-a019-d37353f58e68 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.916173 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1198/2395] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:12.925239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:12.936124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59f895-3a69-4637-9b9a-e6d1d9cb4ecd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:12.941337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:12.942052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.942321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.942598 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] PATH_INFO: `/v3/projects/b5f4e38bf235476dbe29d8bb8fabb670/users/bf6e001f477b411c971ff087d1dfada2/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.944641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f4e38bf235476dbe29d8bb8fabb670, user_id=bf6e001f477b411c971ff087d1dfada2, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:12.947360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:12.957828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1198/2396] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:12 2022] PUT /identity/v3/projects/b5f4e38bf235476dbe29d8bb8fabb670/users/bf6e001f477b411c971ff087d1dfada2/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:12.968349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185002-610d-4b30-b0c1-85aa193a402d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:12.968633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185002-610d-4b30-b0c1-85aa193a402d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:12.968906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58185002-610d-4b30-b0c1-85aa193a402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:12.998295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-58185002-610d-4b30-b0c1-85aa193a402d None None] MFA Rules not processed for user `bf6e001f477b411c971ff087d1dfada2`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:12.999511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-58185002-610d-4b30-b0c1-85aa193a402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:13.029457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:13.071102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1199/2397] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:13.082039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:13.083833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:13.141740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c307e2-6850-4e4a-abf2-69d28229c5a2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:13.145399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:13.146052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:13.146332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:13.146583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:13.155643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:13.157091 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:13.168178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1199/2398] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:13 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:13.215117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58185002-610d-4b30-b0c1-85aa193a402d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:13.233405 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58185002-610d-4b30-b0c1-85aa193a402d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:13.238210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da63eb-4cce-445f-81cc-deb4206c7a43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:13.238927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da63eb-4cce-445f-81cc-deb4206c7a43 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:13.239287 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da63eb-4cce-445f-81cc-deb4206c7a43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:13.239622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da63eb-4cce-445f-81cc-deb4206c7a43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:13.305616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da63eb-4cce-445f-81cc-deb4206c7a43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:13.307359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da63eb-4cce-445f-81cc-deb4206c7a43 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:13.320138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1200/2399] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:16.697971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:16.749413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:16.765060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39d17-72a1-4ada-af37-a2d848833514 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:16.769913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:16.770571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:16.770846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:16.771114 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] PATH_INFO: `/v3/users/6d563be01ec34928a560653bad749264` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:16.772277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d563be01ec34928a560653bad749264)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:16.774312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:16.824067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d563be01ec34928a560653bad749264'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:16.832610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d563be01ec34928a560653bad749264'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:16.833408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d563be01ec34928a560653bad749264'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:16.846150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d563be01ec34928a560653bad749264'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:16.856017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d563be01ec34928a560653bad749264'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:16.862855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1200/2400] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:16 2022] DELETE /identity/v3/users/6d563be01ec34928a560653bad749264 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:16.867619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:16.868090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:16.868184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:16.887484 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:16.888696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:16.947591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1201/2401] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:16.959351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:16.960838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.024968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56dd7d-de53-429b-aef6-4b1e71ea420b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:17.028735 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:17.029448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.029724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.030022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.039253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:17.040818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:17.050206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1201/2402] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:17.330740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:17.332327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.345194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e0270-a3c9-40fb-babb-22c365d604d3 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:17.350330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:17.351013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.351295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.351588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] PATH_INFO: `/v3/projects/6dd7db2d523d4da89e06cdd37bb432b1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.353214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd7db2d523d4da89e06cdd37bb432b1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:17.355990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:17.405787 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd7db2d523d4da89e06cdd37bb432b1', 'request_id': 'req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.414818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd7db2d523d4da89e06cdd37bb432b1', 'request_id': 'req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.417312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:17.422891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd7db2d523d4da89e06cdd37bb432b1', 'request_id': 'req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.436778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] The token cache is being invalidate because project 6dd7db2d523d4da89e06cdd37bb432b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:17.437065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.437710 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.439275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1202/2403] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:17 2022] DELETE /identity/v3/projects/6dd7db2d523d4da89e06cdd37bb432b1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:17.443392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:17.453062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31cfa-bb09-44c3-9615-1ee22fae992f service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:17.538630 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:17.539603 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.540498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.540498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] PATH_INFO: `/v3/users/bf6e001f477b411c971ff087d1dfada2` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.541761 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6e001f477b411c971ff087d1dfada2)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:17.543821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:17.556450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:17.609253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6e001f477b411c971ff087d1dfada2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.617654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6e001f477b411c971ff087d1dfada2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.618498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6e001f477b411c971ff087d1dfada2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.631604 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6e001f477b411c971ff087d1dfada2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.640052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9b776e12-b5c3-4694-9aa3-0de6dd351292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6e001f477b411c971ff087d1dfada2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:17.646112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1202/2404] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:17 2022] DELETE /identity/v3/users/bf6e001f477b411c971ff087d1dfada2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:17.917516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:17.919069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:17.935582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf319cca-7d1f-4f86-a0af-4bb6a661f1df admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:17.993679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:17.994379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:17.994663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:17.994958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] PATH_INFO: `/v3/projects/b5f4e38bf235476dbe29d8bb8fabb670` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:17.996130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f4e38bf235476dbe29d8bb8fabb670)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:17.998133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.048836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f4e38bf235476dbe29d8bb8fabb670', 'request_id': 'req-11215106-5478-4c23-89e1-80a5c703eacb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.058904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f4e38bf235476dbe29d8bb8fabb670', 'request_id': 'req-11215106-5478-4c23-89e1-80a5c703eacb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.065052 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f4e38bf235476dbe29d8bb8fabb670', 'request_id': 'req-11215106-5478-4c23-89e1-80a5c703eacb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.077198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] The token cache is being invalidate because project b5f4e38bf235476dbe29d8bb8fabb670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:18.077497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.078292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-11215106-5478-4c23-89e1-80a5c703eacb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.080013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1203/2405] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:17 2022] DELETE /identity/v3/projects/b5f4e38bf235476dbe29d8bb8fabb670 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:18.085981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa09e-c21a-42c4-8034-626a747801ae None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.086481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa09e-c21a-42c4-8034-626a747801ae None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.086611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bfa09e-c21a-42c4-8034-626a747801ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.108541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-45bfa09e-c21a-42c4-8034-626a747801ae None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:18.109765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-45bfa09e-c21a-42c4-8034-626a747801ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:18.169901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1203/2406] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:18.178219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617c3cb-c394-4e1b-b5ea-9bae63e348f8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.178507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617c3cb-c394-4e1b-b5ea-9bae63e348f8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.178783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617c3cb-c394-4e1b-b5ea-9bae63e348f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.201409 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-0617c3cb-c394-4e1b-b5ea-9bae63e348f8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:18.202769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0617c3cb-c394-4e1b-b5ea-9bae63e348f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:18.212897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1204/2407] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:18.218483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfa09e-c21a-42c4-8034-626a747801ae None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.230871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bfa09e-c21a-42c4-8034-626a747801ae None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.237107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.237743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.238052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.238323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.239022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:18.239327 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.240999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.254287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1204/2408] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:26:18.259243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617c3cb-c394-4e1b-b5ea-9bae63e348f8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.269831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617c3cb-c394-4e1b-b5ea-9bae63e348f8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.275056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.275671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.275942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.276206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.276865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.278874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.308189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1205/2409] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:18 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:18.312545 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.322843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e493a7f-5f81-4f05-981c-dc053bad5035 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.381572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.382214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.382491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.382758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.383414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.385402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.409645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1205/2410] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:18 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:18.414062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.424427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc813d-a536-4217-a2e2-99723fc54361 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.429252 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.429862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.430168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.430435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.431179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.432758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.442660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1206/2411] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:18.446931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.456334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:18.461477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d5e0e-3ae9-4fbe-9b69-b610dd3fca67 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.469530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726419d-af7a-4646-97b9-083ddf13a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.470193 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726419d-af7a-4646-97b9-083ddf13a5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.470479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726419d-af7a-4646-97b9-083ddf13a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.470759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726419d-af7a-4646-97b9-083ddf13a5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.472067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726419d-af7a-4646-97b9-083ddf13a5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.474163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a726419d-af7a-4646-97b9-083ddf13a5e8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.485322 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1206/2412] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:18.489617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.500038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749e3d8-cf41-4e95-992b-7ef62b74ff81 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.505494 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.506135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.506413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.506669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] PATH_INFO: `/v3/projects/dccc0c82c5e84df58d7c147d1ffc96a2/users/eeb9166a45284e4e85497dd09851cc07/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.521746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccc0c82c5e84df58d7c147d1ffc96a2, user_id=eeb9166a45284e4e85497dd09851cc07, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.524961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.542220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1207/2413] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:18 2022] PUT /identity/v3/projects/dccc0c82c5e84df58d7c147d1ffc96a2/users/eeb9166a45284e4e85497dd09851cc07/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:18.554583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997a49-6e02-45f4-9392-9d659fc0b874 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.554868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997a49-6e02-45f4-9392-9d659fc0b874 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.555140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c997a49-6e02-45f4-9392-9d659fc0b874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.585265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9c997a49-6e02-45f4-9392-9d659fc0b874 None None] MFA Rules not processed for user `eeb9166a45284e4e85497dd09851cc07`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:18.586506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9c997a49-6e02-45f4-9392-9d659fc0b874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:18.661366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1207/2414] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:18.672661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.674585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:18.692383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:18.748132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c3590-27d8-4760-9a54-2dd04acb86e3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.751764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e68f4-2833-4da4-a624-939ca21e6e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.752392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e68f4-2833-4da4-a624-939ca21e6e96 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.752667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e68f4-2833-4da4-a624-939ca21e6e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.752935 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e68f4-2833-4da4-a624-939ca21e6e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.761561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e68f4-2833-4da4-a624-939ca21e6e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.763022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e68f4-2833-4da4-a624-939ca21e6e96 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.794027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1208/2415] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:18.804008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c997a49-6e02-45f4-9392-9d659fc0b874 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:18.873479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c997a49-6e02-45f4-9392-9d659fc0b874 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:18.878070 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:18.878906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.879189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.879467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] PATH_INFO: `/v3/users/eeb9166a45284e4e85497dd09851cc07` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.880638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb9166a45284e4e85497dd09851cc07)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:18.882698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:18.936122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb9166a45284e4e85497dd09851cc07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.942975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb9166a45284e4e85497dd09851cc07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.943633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb9166a45284e4e85497dd09851cc07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.955921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb9166a45284e4e85497dd09851cc07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.964564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb9166a45284e4e85497dd09851cc07'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:18.974349 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1208/2416] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:18 2022] DELETE /identity/v3/users/eeb9166a45284e4e85497dd09851cc07 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:18.976722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:18.977184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:18.977512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:18.997325 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:18.998561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:19.059002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1209/2417] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:19.069734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:19.071745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:19.078234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:19.133276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a110f67-8cb3-4416-9467-209d8c3b22d2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:19.137249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4fd04-ef7b-4480-b0f3-0e22d28c82cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:19.137919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fd04-ef7b-4480-b0f3-0e22d28c82cf service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.138302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fd04-ef7b-4480-b0f3-0e22d28c82cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.138699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fd04-ef7b-4480-b0f3-0e22d28c82cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.148029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4fd04-ef7b-4480-b0f3-0e22d28c82cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:19.149634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4fd04-ef7b-4480-b0f3-0e22d28c82cf service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:19.159346 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1209/2418] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:19.482701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:19.484161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:19.498505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468c599-1d04-4361-9e51-5b6304e464df None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:19.506096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:19.506992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.507277 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.508094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] PATH_INFO: `/v3/projects/dccc0c82c5e84df58d7c147d1ffc96a2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.509228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccc0c82c5e84df58d7c147d1ffc96a2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:19.510918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:19.558899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccc0c82c5e84df58d7c147d1ffc96a2', 'request_id': 'req-22335b66-5cad-4813-8d09-abd4cd02131f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:19.567048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccc0c82c5e84df58d7c147d1ffc96a2', 'request_id': 'req-22335b66-5cad-4813-8d09-abd4cd02131f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:19.572796 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccc0c82c5e84df58d7c147d1ffc96a2', 'request_id': 'req-22335b66-5cad-4813-8d09-abd4cd02131f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:19.585469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] The token cache is being invalidate because project dccc0c82c5e84df58d7c147d1ffc96a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:19.585781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:19.586507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-22335b66-5cad-4813-8d09-abd4cd02131f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:19.588201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1210/2419] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:19 2022] DELETE /identity/v3/projects/dccc0c82c5e84df58d7c147d1ffc96a2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:19.593362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6788b-6b1b-4b7e-b89b-4fe5be8420c3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.593648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6788b-6b1b-4b7e-b89b-4fe5be8420c3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.593948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6788b-6b1b-4b7e-b89b-4fe5be8420c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.618996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-bec6788b-6b1b-4b7e-b89b-4fe5be8420c3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:19.620245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bec6788b-6b1b-4b7e-b89b-4fe5be8420c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:19.682211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1210/2420] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:19.690547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc59fa-e9ce-49ca-8754-312cdebc72c0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.690822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc59fa-e9ce-49ca-8754-312cdebc72c0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.691090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc59fa-e9ce-49ca-8754-312cdebc72c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.712383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-57bc59fa-e9ce-49ca-8754-312cdebc72c0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:19.713599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-57bc59fa-e9ce-49ca-8754-312cdebc72c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:19.723802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1211/2421] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:19.728522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6788b-6b1b-4b7e-b89b-4fe5be8420c3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:19.739340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6788b-6b1b-4b7e-b89b-4fe5be8420c3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:19.744513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:19.745125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.745406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.745681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.746411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:19.746719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:19.748332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:19.760581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1211/2422] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:19.764997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc59fa-e9ce-49ca-8754-312cdebc72c0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:19.774874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc59fa-e9ce-49ca-8754-312cdebc72c0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:19.780450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:19.781054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.781328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.781598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.782302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:19.784239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:19.819110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1212/2423] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:19 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:19.823538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:19.834088 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ff3fa-0e60-44f4-8480-42d1b1f73f0a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:19.892963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:19.893617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.893876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.894196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.894865 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:19.896807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:19.922369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1212/2424] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:19 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:19.923947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:19.934990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119ec5c-225c-4418-8bbd-1d48a12cce5a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:19.939924 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:19.940554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.940795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.941200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.941899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:19.943624 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:19.949554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:19.955234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1213/2425] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:19.959173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:19.969557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13b7bd-c395-4d28-b63a-a659d9baa42c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:19.974976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7729ef-4993-45c5-8e58-525f1dd67755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:19.975633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7729ef-4993-45c5-8e58-525f1dd67755 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:19.975913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7729ef-4993-45c5-8e58-525f1dd67755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:19.976189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7729ef-4993-45c5-8e58-525f1dd67755 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:19.976893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7729ef-4993-45c5-8e58-525f1dd67755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:19.978677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7729ef-4993-45c5-8e58-525f1dd67755 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:19.991163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1213/2426] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:26:19.995679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:20.005841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e8f41-0303-48cf-b129-edaf6999dceb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:20.010711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:20.011382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:20.011660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:20.011931 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] PATH_INFO: `/v3/projects/43fe7165c5414a5f96ce14538cba87ad/users/b060ac05eccb4ff9a96f516ab57a78d3/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:20.027346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fe7165c5414a5f96ce14538cba87ad, user_id=b060ac05eccb4ff9a96f516ab57a78d3, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:20.030010 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:20.045109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1214/2427] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:19 2022] PUT /identity/v3/projects/43fe7165c5414a5f96ce14538cba87ad/users/b060ac05eccb4ff9a96f516ab57a78d3/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:20.054222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766702e-6325-4132-936f-afb23ed70b55 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:20.054530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766702e-6325-4132-936f-afb23ed70b55 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:20.054803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766702e-6325-4132-936f-afb23ed70b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:20.075021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8766702e-6325-4132-936f-afb23ed70b55 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:20.076149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8766702e-6325-4132-936f-afb23ed70b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:20.081160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:20.138147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1214/2428] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:20.147797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:20.149588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:20.206894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb05298-7857-4fd8-a818-774b3aff476a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:20.210729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:20.211382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:20.211682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:20.211988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:20.221214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:20.222671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:20.232394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1215/2429] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:20.937956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:20.938249 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:20.938521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:20.968467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] MFA Rules not processed for user `b060ac05eccb4ff9a96f516ab57a78d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:20.969654 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:21.038232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1215/2430] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:21.049020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:21.050696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:21.127770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152f567-d0d5-4099-bd76-f1518929b3ea service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:21.130844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:21.131469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:21.131743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:21.132012 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:21.140808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:21.142394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:21.151430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1216/2431] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:22.174884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:22.176369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:22.278360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fd7fc-8622-43c3-a897-bef5e815e74d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:22.292584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c19f39-6242-47fb-93ab-42ea2dc39624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:22.295094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19f39-6242-47fb-93ab-42ea2dc39624 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:22.295395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19f39-6242-47fb-93ab-42ea2dc39624 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:22.295695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19f39-6242-47fb-93ab-42ea2dc39624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:22.299800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-19c19f39-6242-47fb-93ab-42ea2dc39624 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:22.314972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c19f39-6242-47fb-93ab-42ea2dc39624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:22.317345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c19f39-6242-47fb-93ab-42ea2dc39624 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:22.331977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1216/2432] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:22.397675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:22.416943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d28b2-e3b1-4dfb-ba78-82b99191b0af service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:22.429288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:22.430353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:22.430783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:22.431218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:22.434044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:22.501256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:22.502839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:22.513237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1217/2433] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:22.595410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:22.595696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:22.596530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:22.619596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] MFA Rules not processed for user `b060ac05eccb4ff9a96f516ab57a78d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:22.621067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:22.629633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1217/2434] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:22.978877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:22.989054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc41c4-ffbb-4a90-96e7-72e37a74a0fb service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:22.992951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:22.993625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:22.993901 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:22.994422 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:22.996403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:23.007430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:23.009157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:23.018581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1218/2435] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:23.362307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:23.364494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:23.388829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:23.440731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ee75f-6e73-41a7-b7e8-f303d702a991 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:23.445879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:23.446579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:23.446835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:23.447107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:23.448857 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:23.460161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:23.461829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:23.471782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1218/2436] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:25.482967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:25.485671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:25.501900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08f221-569f-4d93-9243-9116a091536c service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:25.507691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:25.508314 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:25.508592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:25.508866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:25.511004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:25.518346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:25.523763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:25.525462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:25.535368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1219/2437] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:28.393716 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:28.403874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406da18-e02d-4cbd-b5a9-33bcff1d2960 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:28.408670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:28.409562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:28.410189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:28.410904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:28.413679 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:28.430632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:28.433112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:28.445743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1219/2438] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:32.238726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:32.244422 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:32.267689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698f2eb-ec49-4904-9f91-20ac6698ebeb service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:32.273832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:32.295876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dd1af-1e13-4d73-aa0f-33b980cf5b1a service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:32.296219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:32.297779 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:32.298102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:32.299940 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:32.304322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:32.310387 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:32.312573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:32.313897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:32.315302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:32.334116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:32.366708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:32.374995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:32.381493 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:32.386552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:32.414386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1220/2439] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:32.420386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:32.421100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1220/2440] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:32.422248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:32.460230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147683-599a-4973-8c3b-0624d06daf18 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:32.476750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:32.477523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:32.477872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:32.478224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] PATH_INFO: `/v3/users/eef6662134a14362bd6dd6d1a13b2e63` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:32.481959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef6662134a14362bd6dd6d1a13b2e63)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:32.484103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:32.561206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef6662134a14362bd6dd6d1a13b2e63'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:32.572682 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef6662134a14362bd6dd6d1a13b2e63'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:32.590398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef6662134a14362bd6dd6d1a13b2e63'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:32.591259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef6662134a14362bd6dd6d1a13b2e63'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:32.599827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63796851-62b3-4dc1-b9db-4031052508e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef6662134a14362bd6dd6d1a13b2e63'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:32.610089 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1221/2441] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:32 2022] DELETE /identity/v3/users/eef6662134a14362bd6dd6d1a13b2e63 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:32.798044 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:32.822443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d666f-deae-4ba0-ab8e-9ea58065bea7 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:32.916277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:32.917681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:32.918081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:32.918494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] PATH_INFO: `/v3/projects/6fe21a0eece0476aa30f6738b3d394be` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:32.919760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe21a0eece0476aa30f6738b3d394be)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:32.922120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:32.991540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe21a0eece0476aa30f6738b3d394be', 'request_id': 'req-a974501b-a3b6-4a6f-9536-12a3601cea1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:33.001670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe21a0eece0476aa30f6738b3d394be', 'request_id': 'req-a974501b-a3b6-4a6f-9536-12a3601cea1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:33.008068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe21a0eece0476aa30f6738b3d394be', 'request_id': 'req-a974501b-a3b6-4a6f-9536-12a3601cea1b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:33.022035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] The token cache is being invalidate because project 6fe21a0eece0476aa30f6738b3d394be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:33.022505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:33.023575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a974501b-a3b6-4a6f-9536-12a3601cea1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:33.025800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1221/2442] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:32 2022] DELETE /identity/v3/projects/6fe21a0eece0476aa30f6738b3d394be => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:33.031116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ecdf-f052-4422-88aa-898bbc42e9ac None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.031495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ecdf-f052-4422-88aa-898bbc42e9ac None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.031863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54ecdf-f052-4422-88aa-898bbc42e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.063852 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dc54ecdf-f052-4422-88aa-898bbc42e9ac None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:33.067353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dc54ecdf-f052-4422-88aa-898bbc42e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:33.177658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1222/2443] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:33.185618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38748e-d240-472f-a8fe-040519fd083f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.186701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38748e-d240-472f-a8fe-040519fd083f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.187391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec38748e-d240-472f-a8fe-040519fd083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.228009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ec38748e-d240-472f-a8fe-040519fd083f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:33.228874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ec38748e-d240-472f-a8fe-040519fd083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:33.247182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1222/2444] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:33.251487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54ecdf-f052-4422-88aa-898bbc42e9ac None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.263646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54ecdf-f052-4422-88aa-898bbc42e9ac None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.268747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.274934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.275468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.275819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.276831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:33.277218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.279699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.308218 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1223/2445] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:33.309495 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38748e-d240-472f-a8fe-040519fd083f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.322785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec38748e-d240-472f-a8fe-040519fd083f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.330776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.332283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.332727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.333410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.334100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.336115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.342174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:33.374986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1223/2446] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:33 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:26:33.381168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.392847 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668a3da-02cf-4e40-a981-0f596c2ae679 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.437436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:33.462887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.463528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.463801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.464070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.464744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.466748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.490297 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1224/2447] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:33 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:33.497589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.511488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220201a-a487-4c31-b2f8-b7ce6800ebcc admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.517006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.517646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.517979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.518227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.518948 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.520568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.531864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1224/2448] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:33.535844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.546587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f64258-8e33-4728-836e-227dc8716cc6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.552047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da871943-906d-4ea3-8410-24710217d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.553094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da871943-906d-4ea3-8410-24710217d5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.553094 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da871943-906d-4ea3-8410-24710217d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.553278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da871943-906d-4ea3-8410-24710217d5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.553908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da871943-906d-4ea3-8410-24710217d5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.555714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da871943-906d-4ea3-8410-24710217d5dc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.570797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1225/2449] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:33.572853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.583640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb8cdb-7754-4ebe-98c5-6b38d795327e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.589110 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.589821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.590140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.590411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] PATH_INFO: `/v3/projects/5a95bb241b0745efb2a87539ff25a619/users/e4f717e3b53549158871db13fae471b3/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.610197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a95bb241b0745efb2a87539ff25a619, user_id=e4f717e3b53549158871db13fae471b3, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.612911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.628445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1225/2450] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:33 2022] PUT /identity/v3/projects/5a95bb241b0745efb2a87539ff25a619/users/e4f717e3b53549158871db13fae471b3/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:33.640496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f166b-9d95-49d3-8664-47ffeda1b7bf None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.640878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f166b-9d95-49d3-8664-47ffeda1b7bf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.641146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f166b-9d95-49d3-8664-47ffeda1b7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.672802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2f9f166b-9d95-49d3-8664-47ffeda1b7bf None None] MFA Rules not processed for user `e4f717e3b53549158871db13fae471b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:33.674059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2f9f166b-9d95-49d3-8664-47ffeda1b7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:33.737383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1226/2451] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:33.741923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.805486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8480d-65f6-4861-afb3-263a4fdd368a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.810643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.811286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.811621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.811956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.812650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.814610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.846096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1226/2452] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:33 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:33.848749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f166b-9d95-49d3-8664-47ffeda1b7bf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.859956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f166b-9d95-49d3-8664-47ffeda1b7bf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.920907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.921501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.921804 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.922116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.922801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.924716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.945563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1227/2453] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:33 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:33.949960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:33.960608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab781d-249a-49f3-a795-eaab3f6e82b3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:33.965415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:33.966062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:33.966338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:33.966608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:33.967280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:33.968893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:33.979475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1227/2454] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:33.984170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:34.001206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4bd33-0d49-4354-9d45-2d8038ed2db1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:34.006481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:34.007163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:34.007438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:34.007707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] PATH_INFO: `/v3/projects/4df89bd591544a8db9304b97aeb07d05/users/4ea297d7fd044f7a86ba9fac0e9b6933/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:34.025366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df89bd591544a8db9304b97aeb07d05, user_id=4ea297d7fd044f7a86ba9fac0e9b6933, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:34.028695 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:34.043469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1228/2455] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:33 2022] PUT /identity/v3/projects/4df89bd591544a8db9304b97aeb07d05/users/4ea297d7fd044f7a86ba9fac0e9b6933/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:34.047358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:34.058238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc21e5-02ec-4422-ac88-c58479ce4482 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:34.128955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859f1fe-d3ae-4c82-a5e5-3001726e3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:34.129549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f1fe-d3ae-4c82-a5e5-3001726e3b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:34.129836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f1fe-d3ae-4c82-a5e5-3001726e3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:34.130132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859f1fe-d3ae-4c82-a5e5-3001726e3b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:34.130902 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859f1fe-d3ae-4c82-a5e5-3001726e3b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:34.132641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859f1fe-d3ae-4c82-a5e5-3001726e3b8a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:34.144639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1228/2456] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:34.148926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:34.159992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe5533-7035-4b9f-9f3b-97a0890c8b6f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:34.165236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55584d4-b889-48fb-98fc-9d470383f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:34.165441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55584d4-b889-48fb-98fc-9d470383f62b admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:34.165689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55584d4-b889-48fb-98fc-9d470383f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:34.165977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55584d4-b889-48fb-98fc-9d470383f62b admin admin] PATH_INFO: `/v3/projects/4df89bd591544a8db9304b97aeb07d05/users/4ea297d7fd044f7a86ba9fac0e9b6933/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:34.168271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55584d4-b889-48fb-98fc-9d470383f62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df89bd591544a8db9304b97aeb07d05, user_id=4ea297d7fd044f7a86ba9fac0e9b6933, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:34.170947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55584d4-b889-48fb-98fc-9d470383f62b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:34.177721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:34.186046 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1229/2457] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:34 2022] PUT /identity/v3/projects/4df89bd591544a8db9304b97aeb07d05/users/4ea297d7fd044f7a86ba9fac0e9b6933/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:34.198350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:34.198350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:34.198350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:34.233585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] MFA Rules not processed for user `4ea297d7fd044f7a86ba9fac0e9b6933`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:34.234930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:34.243950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:34.279154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:34.279694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:34.279694 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:34.302599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:34.303345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:34.324714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1229/2458] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:34.337483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:34.339664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:34.373452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1230/2459] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:34.422056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a314c-7e81-4304-90b7-abda55dcb101 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:34.427120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:34.428041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:34.428580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:34.429014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:34.436097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:34.437522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:34.442186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:34.444087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:34.455161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1230/2460] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:34.552757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15fc8f-c175-432e-8024-bf43ee43b939 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:34.561827 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33635c-88dd-461d-b0fd-4eeaccb8515a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:34.562672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33635c-88dd-461d-b0fd-4eeaccb8515a service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:34.563018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33635c-88dd-461d-b0fd-4eeaccb8515a service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:34.563355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33635c-88dd-461d-b0fd-4eeaccb8515a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:34.581187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33635c-88dd-461d-b0fd-4eeaccb8515a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:34.582870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33635c-88dd-461d-b0fd-4eeaccb8515a service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:34.598130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1231/2461] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 06 01:26:35.084671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:35.202119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886ad69-8b49-456f-8e8e-b3fdb1882902 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:35.214613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:35.215359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:35.215647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:35.215929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] PATH_INFO: `/v3/users/e4f717e3b53549158871db13fae471b3` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:35.220022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f717e3b53549158871db13fae471b3)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:35.222946 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:35.298709 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f717e3b53549158871db13fae471b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:35.301236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:35.309742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f717e3b53549158871db13fae471b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:35.310688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f717e3b53549158871db13fae471b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:35.339505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f717e3b53549158871db13fae471b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:35.348509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f717e3b53549158871db13fae471b3'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:35.361245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1231/2462] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:35 2022] DELETE /identity/v3/users/e4f717e3b53549158871db13fae471b3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:35.363074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:35.363548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:35.363632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:35.386988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:35.388551 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:35.465315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1232/2463] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:35.475471 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:35.477333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:35.546384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e08b86-56c4-4183-a07e-2ad8e5a74237 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:35.550353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:35.551065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:35.551218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:35.551543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:35.562127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:35.563608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:35.575983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1232/2464] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:35.927163 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:35.928830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:35.948181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ad619-962d-430c-ae93-60762b78d324 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:35.953125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:35.954112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:35.954746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:35.955323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] PATH_INFO: `/v3/projects/5a95bb241b0745efb2a87539ff25a619` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:35.956495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a95bb241b0745efb2a87539ff25a619)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:35.958582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:36.026597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:36.047360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a95bb241b0745efb2a87539ff25a619', 'request_id': 'req-f21ae023-a27a-4161-aa2d-31f195f7cc12'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.062446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a95bb241b0745efb2a87539ff25a619', 'request_id': 'req-f21ae023-a27a-4161-aa2d-31f195f7cc12'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.069584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a95bb241b0745efb2a87539ff25a619', 'request_id': 'req-f21ae023-a27a-4161-aa2d-31f195f7cc12'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.083452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] The token cache is being invalidate because project 5a95bb241b0745efb2a87539ff25a619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:36.083452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.084508 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.086549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1233/2465] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:35 2022] DELETE /identity/v3/projects/5a95bb241b0745efb2a87539ff25a619 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:36.090446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:36.100704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527f1d-50bb-4cd5-b946-4b4263c46c0b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:36.189796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:36.190927 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:36.191489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:36.192205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] PATH_INFO: `/v3/users/4ea297d7fd044f7a86ba9fac0e9b6933` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:36.193967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea297d7fd044f7a86ba9fac0e9b6933)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:36.196943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:36.278085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea297d7fd044f7a86ba9fac0e9b6933'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.293014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea297d7fd044f7a86ba9fac0e9b6933'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.294434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea297d7fd044f7a86ba9fac0e9b6933'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.307898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:36.310087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea297d7fd044f7a86ba9fac0e9b6933'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.339645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-dae554e5-76ab-4828-8262-691a6aa3408c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea297d7fd044f7a86ba9fac0e9b6933'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.360886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1233/2466] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:36 2022] DELETE /identity/v3/users/4ea297d7fd044f7a86ba9fac0e9b6933 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:36.736554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:36.738095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:36.753627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae023-a27a-4161-aa2d-31f195f7cc12 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:36.833639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:36.834640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:36.834922 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:36.835200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] PATH_INFO: `/v3/projects/4df89bd591544a8db9304b97aeb07d05` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:36.836498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df89bd591544a8db9304b97aeb07d05)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:36.838699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:36.891585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df89bd591544a8db9304b97aeb07d05', 'request_id': 'req-d73a98c2-a779-401f-bc52-a3ccb237b3b9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.907305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df89bd591544a8db9304b97aeb07d05', 'request_id': 'req-d73a98c2-a779-401f-bc52-a3ccb237b3b9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.915942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df89bd591544a8db9304b97aeb07d05', 'request_id': 'req-d73a98c2-a779-401f-bc52-a3ccb237b3b9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.927564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] The token cache is being invalidate because project 4df89bd591544a8db9304b97aeb07d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:36.927862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.930399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-d73a98c2-a779-401f-bc52-a3ccb237b3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:36.932954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1234/2467] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:36 2022] DELETE /identity/v3/projects/4df89bd591544a8db9304b97aeb07d05 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:36.937911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ccd1-05af-4589-be35-93d3109e70e5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:36.938320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ccd1-05af-4589-be35-93d3109e70e5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:36.938670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21ccd1-05af-4589-be35-93d3109e70e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:36.962306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9e21ccd1-05af-4589-be35-93d3109e70e5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:36.963997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9e21ccd1-05af-4589-be35-93d3109e70e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:37.048675 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1234/2468] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:37.057774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226d836-d462-478b-a580-f69b69c35c72 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.058092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226d836-d462-478b-a580-f69b69c35c72 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.058352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226d836-d462-478b-a580-f69b69c35c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.087716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b226d836-d462-478b-a580-f69b69c35c72 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:37.089335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b226d836-d462-478b-a580-f69b69c35c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:37.099247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1235/2469] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:37.103783 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21ccd1-05af-4589-be35-93d3109e70e5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.118255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21ccd1-05af-4589-be35-93d3109e70e5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.126970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.127714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.128090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.128508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.129332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:37.129730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.131501 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:37.153950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1235/2470] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:37.155278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226d836-d462-478b-a580-f69b69c35c72 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.168140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226d836-d462-478b-a580-f69b69c35c72 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.178351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.179121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.180590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.181416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.182979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.186024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:37.230838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1236/2471] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:37 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:37.236813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.248921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8972fa0-70a3-4f2a-a1d1-63b0c0f90c03 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.315930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.316586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.316867 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.317139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.317830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.319814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:37.344278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1236/2472] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:37 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:37.348529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.361208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57413e-3d58-4c2d-a1c4-cca935f587e2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.366033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.366755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.367136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.367468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.368242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.369946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:37.381073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1237/2473] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:37.385306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.396808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ebce1-d8fe-49a8-a388-1355ad282dad admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.401994 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488bc4-b41a-430a-9f78-8e30748d26fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.402672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488bc4-b41a-430a-9f78-8e30748d26fb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.402950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488bc4-b41a-430a-9f78-8e30748d26fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.403220 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488bc4-b41a-430a-9f78-8e30748d26fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.404573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488bc4-b41a-430a-9f78-8e30748d26fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.406229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06488bc4-b41a-430a-9f78-8e30748d26fb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:37.418594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1237/2474] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:26:37.423736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.435038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570da34a-5986-4b83-b26c-51f17f905ae7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.440439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.441365 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.442718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.445180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] PATH_INFO: `/v3/projects/88215046a90c41c085668bc311063d2e/users/9e9eb9c8b9204fcaa8049ee053e45c9b/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.454021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:37.477749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=88215046a90c41c085668bc311063d2e, user_id=9e9eb9c8b9204fcaa8049ee053e45c9b, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.480959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:37.502286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1238/2475] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:37 2022] PUT /identity/v3/projects/88215046a90c41c085668bc311063d2e/users/9e9eb9c8b9204fcaa8049ee053e45c9b/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:37.520135 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c8bd-63cd-4afb-82ff-2d8a4571641e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.520573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c8bd-63cd-4afb-82ff-2d8a4571641e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.520950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c8bd-63cd-4afb-82ff-2d8a4571641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.553974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-acd6c8bd-63cd-4afb-82ff-2d8a4571641e None None] MFA Rules not processed for user `9e9eb9c8b9204fcaa8049ee053e45c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:37.555421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-acd6c8bd-63cd-4afb-82ff-2d8a4571641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:37.608506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:37.637758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1238/2476] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:37.639805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.758853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40e308-c4f9-4303-bd0c-abb107a56aea admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.772821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.773708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.774141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.774512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.775300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.777664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:37.835596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1239/2477] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:37 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:37.842047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c8bd-63cd-4afb-82ff-2d8a4571641e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:37.856736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c8bd-63cd-4afb-82ff-2d8a4571641e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:37.952730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:37.953540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:37.954310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:37.954934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:37.955633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:37.958271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:38.001032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1239/2478] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:37 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:38.002474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:38.014616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb3172-1bc1-45f6-b31f-de92f1166876 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:38.021430 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:38.022440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:38.022819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:38.023190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:38.024064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:38.025810 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:38.039528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1240/2479] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:38.044267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:38.059640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8df662-8194-40a4-b113-e2c12d38acef admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:38.064368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:38.065338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:38.065338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:38.065632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] PATH_INFO: `/v3/projects/6d3d32c480c94eeab5b3b1bd8de6ef4b/users/5c461a01245946e1ab5ea9215ee37021/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:38.084231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3d32c480c94eeab5b3b1bd8de6ef4b, user_id=5c461a01245946e1ab5ea9215ee37021, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:38.087252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:38.111109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1240/2480] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:38 2022] PUT /identity/v3/projects/6d3d32c480c94eeab5b3b1bd8de6ef4b/users/5c461a01245946e1ab5ea9215ee37021/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:38.113239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:38.134015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc13a8f-715f-4660-94af-d753309bf77c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:38.202611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b2025-1a8c-4c59-8414-ef72a0e08369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:38.203457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2025-1a8c-4c59-8414-ef72a0e08369 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:38.203917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2025-1a8c-4c59-8414-ef72a0e08369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:38.204390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b2025-1a8c-4c59-8414-ef72a0e08369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:38.205526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b2025-1a8c-4c59-8414-ef72a0e08369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:38.207383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b2025-1a8c-4c59-8414-ef72a0e08369 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:38.220966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1241/2481] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:26:38.225553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:38.239143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f93dff-225a-4a43-a45a-a98d2f74e19e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:38.246218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:38.246991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:38.247171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:38.247445 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] PATH_INFO: `/v3/projects/6d3d32c480c94eeab5b3b1bd8de6ef4b/users/5c461a01245946e1ab5ea9215ee37021/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:38.252546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3d32c480c94eeab5b3b1bd8de6ef4b, user_id=5c461a01245946e1ab5ea9215ee37021, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:38.255878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:38.271447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1241/2482] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:38 2022] PUT /identity/v3/projects/6d3d32c480c94eeab5b3b1bd8de6ef4b/users/5c461a01245946e1ab5ea9215ee37021/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:38.282096 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a870b0-a465-40c6-86db-e0c413106a49 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:38.282743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a870b0-a465-40c6-86db-e0c413106a49 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:38.282870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a870b0-a465-40c6-86db-e0c413106a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:38.345418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-12a870b0-a465-40c6-86db-e0c413106a49 None None] MFA Rules not processed for user `5c461a01245946e1ab5ea9215ee37021`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:38.349778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-12a870b0-a465-40c6-86db-e0c413106a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:38.416188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:38.466061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1242/2483] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:38.484094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:38.487192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:38.561795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efdb162-ef30-4629-affb-51d220a2f734 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:38.567361 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:38.568057 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:38.568360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:38.568633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:38.590258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:38.592441 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:38.616528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1242/2484] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:38.737854 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a870b0-a465-40c6-86db-e0c413106a49 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:38.749407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a870b0-a465-40c6-86db-e0c413106a49 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:38.753699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec3c47-00bd-414c-9176-827286881f12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:38.754570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec3c47-00bd-414c-9176-827286881f12 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:38.755003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec3c47-00bd-414c-9176-827286881f12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:38.755506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec3c47-00bd-414c-9176-827286881f12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:38.833888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec3c47-00bd-414c-9176-827286881f12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:38.836637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec3c47-00bd-414c-9176-827286881f12 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:38.850303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1243/2485] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:39.138659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:39.140164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:39.191745 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:39.210256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64da4a-7212-4299-ba95-501a5e4ccf1d service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:39.214786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:39.215481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:39.215678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:39.215986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:39.217958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:39.306568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:39.309428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:39.321556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1243/2486] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:39.811419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4418-1d57-48c7-91b6-94888c820253 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:39.812256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4418-1d57-48c7-91b6-94888c820253 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:39.812544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c4418-1d57-48c7-91b6-94888c820253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:39.838888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9e8c4418-1d57-48c7-91b6-94888c820253 None None] MFA Rules not processed for user `b060ac05eccb4ff9a96f516ab57a78d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:39.840211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9e8c4418-1d57-48c7-91b6-94888c820253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:39.904274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1244/2487] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:40.604742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:40.614915 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb709b-8929-4735-9c35-bd693fad010a service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:40.619963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de638a4-f93a-416a-a2d7-d26eff22d374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:40.620762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de638a4-f93a-416a-a2d7-d26eff22d374 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:40.621140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de638a4-f93a-416a-a2d7-d26eff22d374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:40.622074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de638a4-f93a-416a-a2d7-d26eff22d374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:40.626071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6de638a4-f93a-416a-a2d7-d26eff22d374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:40.640144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de638a4-f93a-416a-a2d7-d26eff22d374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:40.643330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de638a4-f93a-416a-a2d7-d26eff22d374 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:40.660925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1244/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:42.003501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4418-1d57-48c7-91b6-94888c820253 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:42.026824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c4418-1d57-48c7-91b6-94888c820253 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:42.038298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:42.044722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:42.047703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:42.048194 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] PATH_INFO: `/v3/users/9e9eb9c8b9204fcaa8049ee053e45c9b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:42.049841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9eb9c8b9204fcaa8049ee053e45c9b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:42.053063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:42.156055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9eb9c8b9204fcaa8049ee053e45c9b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:42.170329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9eb9c8b9204fcaa8049ee053e45c9b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:42.188129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9eb9c8b9204fcaa8049ee053e45c9b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:42.189164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9eb9c8b9204fcaa8049ee053e45c9b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:42.195759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:42.198620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9eb9c8b9204fcaa8049ee053e45c9b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:42.206877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1245/2489] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:42 2022] DELETE /identity/v3/users/9e9eb9c8b9204fcaa8049ee053e45c9b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:42.211760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:42.212711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:42.213364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:42.250491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:42.252390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:42.427690 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1245/2490] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:42.437855 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:42.441049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:42.577969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa520-d572-423a-86e4-ffdc71fd0368 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:42.583272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:42.584074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:42.584570 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:42.584941 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:42.599735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:42.601500 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:42.613317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1246/2491] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:43.765312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:43.768116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:43.801099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7e25a-3d19-4304-a971-317bc26c6994 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:43.816752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:43.818243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:43.819002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:43.819419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] PATH_INFO: `/v3/projects/88215046a90c41c085668bc311063d2e` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:43.825102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88215046a90c41c085668bc311063d2e)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:43.827530 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:43.983150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88215046a90c41c085668bc311063d2e', 'request_id': 'req-21b6edd6-4d7d-416d-ac92-e8854444afd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.009487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88215046a90c41c085668bc311063d2e', 'request_id': 'req-21b6edd6-4d7d-416d-ac92-e8854444afd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.023619 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88215046a90c41c085668bc311063d2e', 'request_id': 'req-21b6edd6-4d7d-416d-ac92-e8854444afd0'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.052125 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:44.065779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] The token cache is being invalidate because project 88215046a90c41c085668bc311063d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:44.067877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.068963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.092465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1246/2492] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:43 2022] DELETE /identity/v3/projects/88215046a90c41c085668bc311063d2e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:44.095890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:44.108470 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2399091-12a2-4f81-a3f0-947baadd7b9a service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:44.259341 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:44.260134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:44.260493 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:44.260786 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] PATH_INFO: `/v3/users/5c461a01245946e1ab5ea9215ee37021` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:44.263219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c461a01245946e1ab5ea9215ee37021)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:44.267716 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:44.374648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c461a01245946e1ab5ea9215ee37021'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.388679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c461a01245946e1ab5ea9215ee37021'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.406942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c461a01245946e1ab5ea9215ee37021'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.407701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c461a01245946e1ab5ea9215ee37021'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.415217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c461a01245946e1ab5ea9215ee37021'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:44.424692 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1247/2493] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:44 2022] DELETE /identity/v3/users/5c461a01245946e1ab5ea9215ee37021 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:44.813096 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:44.816581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:44.837433 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6edd6-4d7d-416d-ac92-e8854444afd0 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:44.962171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:44.963221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:44.963840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:44.964309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] PATH_INFO: `/v3/users/46c3c63c45ed4882bd7b4b70bea2f613` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:44.968294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c3c63c45ed4882bd7b4b70bea2f613)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:44.970930 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:45.083832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c3c63c45ed4882bd7b4b70bea2f613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.092505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c3c63c45ed4882bd7b4b70bea2f613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.093658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c3c63c45ed4882bd7b4b70bea2f613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.108774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c3c63c45ed4882bd7b4b70bea2f613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.127086 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-65b7076f-bf90-4936-aad1-2f697fb505c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c3c63c45ed4882bd7b4b70bea2f613'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.148706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1247/2494] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:44 2022] DELETE /identity/v3/users/46c3c63c45ed4882bd7b4b70bea2f613 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:45.240926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:45.242892 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:45.263302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65771892-2d57-4b47-90f6-5affda87fcea admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:45.298352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:45.438105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:45.439436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:45.439869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:45.440288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] PATH_INFO: `/v3/projects/6d3d32c480c94eeab5b3b1bd8de6ef4b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.442117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3d32c480c94eeab5b3b1bd8de6ef4b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:45.445213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:45.570910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3d32c480c94eeab5b3b1bd8de6ef4b', 'request_id': 'req-794bac2e-8389-4e33-b351-4d1aaa2e5b08'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.585226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3d32c480c94eeab5b3b1bd8de6ef4b', 'request_id': 'req-794bac2e-8389-4e33-b351-4d1aaa2e5b08'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.592826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3d32c480c94eeab5b3b1bd8de6ef4b', 'request_id': 'req-794bac2e-8389-4e33-b351-4d1aaa2e5b08'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.606195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] The token cache is being invalidate because project 6d3d32c480c94eeab5b3b1bd8de6ef4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:45.606705 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.607813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-794bac2e-8389-4e33-b351-4d1aaa2e5b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.609114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1248/2495] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:45 2022] DELETE /identity/v3/projects/6d3d32c480c94eeab5b3b1bd8de6ef4b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:45.613991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612983e-a0d4-4877-a79e-7b34d0816983 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:45.614261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612983e-a0d4-4877-a79e-7b34d0816983 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:45.614720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7612983e-a0d4-4877-a79e-7b34d0816983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.640741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7612983e-a0d4-4877-a79e-7b34d0816983 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:45.640741 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7612983e-a0d4-4877-a79e-7b34d0816983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:45.719301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1248/2496] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:45.727748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:45.728107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:45.728382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.760345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:45.760815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:45.771054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1249/2497] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:45.775868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612983e-a0d4-4877-a79e-7b34d0816983 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:45.787829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7612983e-a0d4-4877-a79e-7b34d0816983 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:45.794480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:45.797547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:45.798235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:45.798517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:45.798792 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.799532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:45.799837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:45.801527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:45.805081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:45.826109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ef43a-2ed3-4ed4-9b5d-3651526d9a2c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:45.831308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1249/2498] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:45.833333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:45.835324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:45.836230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:45.836707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] PATH_INFO: `/v3/projects/78e711b72a0143a1a6be082c862841d1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.838161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:45.839201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e711b72a0143a1a6be082c862841d1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:45.842031 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:45.862309 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e834f-065e-4ca5-9f71-315c945b78a3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:45.878556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:45.879118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:45.879408 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:45.880606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:45.881005 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:45.884515 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:45.922405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:45.941150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e711b72a0143a1a6be082c862841d1', 'request_id': 'req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.952262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e711b72a0143a1a6be082c862841d1', 'request_id': 'req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.954007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1250/2499] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:45 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:45.958461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:45.961321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e711b72a0143a1a6be082c862841d1', 'request_id': 'req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.995183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] The token cache is being invalidate because project 78e711b72a0143a1a6be082c862841d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:45.995669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:45.999628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5f5eac7c-240a-4fd5-b4f5-17f7acb6f20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:46.002415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1250/2500] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:45 2022] DELETE /identity/v3/projects/78e711b72a0143a1a6be082c862841d1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:46.009238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f0c3-25cd-453e-abde-888d540707fa None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.009238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f0c3-25cd-453e-abde-888d540707fa None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.009238 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f0c3-25cd-453e-abde-888d540707fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.044473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ea95f0c3-25cd-453e-abde-888d540707fa None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:46.045636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ea95f0c3-25cd-453e-abde-888d540707fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.076119 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:46.078746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a30d3-50f5-4181-86b7-3b0e09eeca24 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.098372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.101621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.103024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.104834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.107291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.109546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.151185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1251/2501] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:45 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:46.154822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.156787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.169456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1251/2502] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:46.176904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28b6f4-ad87-4287-bc5b-bfe3cf442566 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.177795 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4dd2-3519-4e28-85ed-b32d6f9644db None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.178113 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4dd2-3519-4e28-85ed-b32d6f9644db None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.178444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af4dd2-3519-4e28-85ed-b32d6f9644db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.186784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.190153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.191543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.193234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.196414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.198768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.201062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-36af4dd2-3519-4e28-85ed-b32d6f9644db None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:46.202330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-36af4dd2-3519-4e28-85ed-b32d6f9644db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.211063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1252/2503] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:46.212267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1252/2504] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:46.215362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4dd2-3519-4e28-85ed-b32d6f9644db None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.215895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.228727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af4dd2-3519-4e28-85ed-b32d6f9644db None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.231573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431405d8-ae65-4d30-afd0-708dfb0045cb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.234627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.235333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.237379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.238236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.238519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.238796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.239823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.239954 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.241371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.247139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.248220 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:46.248598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.250593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.256968 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1253/2505] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:46.261245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.266676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1253/2506] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 06 01:26:46.271575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.272477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ba3d6-72e1-43d6-a802-30e6d626841c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.277671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96acdf3-7275-4a7a-8bef-67a7a7c0d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.278383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acdf3-7275-4a7a-8bef-67a7a7c0d9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.278708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acdf3-7275-4a7a-8bef-67a7a7c0d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.279231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96acdf3-7275-4a7a-8bef-67a7a7c0d9e5 admin admin] PATH_INFO: `/v3/projects/4ae5107603fd49b89a2671a227c1e1e8/users/0a6e068821a2439789b748dcb207c61b/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.284544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405bab5-f0dc-4375-9027-ce6a92d439be admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.290371 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.291138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.291524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.294150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.295671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96acdf3-7275-4a7a-8bef-67a7a7c0d9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae5107603fd49b89a2671a227c1e1e8, user_id=0a6e068821a2439789b748dcb207c61b, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.297201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.298801 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96acdf3-7275-4a7a-8bef-67a7a7c0d9e5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.300362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.319663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1254/2507] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:46 2022] PUT /identity/v3/projects/4ae5107603fd49b89a2671a227c1e1e8/users/0a6e068821a2439789b748dcb207c61b/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:46.331488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.332237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.332663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.342865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1254/2508] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:46 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:46.348446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.369269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] MFA Rules not processed for user `0a6e068821a2439789b748dcb207c61b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:46.370833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.444087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8e5e3-7de9-40ab-9e76-06bca4260967 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.449876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.450724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.451000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.451267 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.451933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.454987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.462371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1255/2509] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:46.483165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.484824 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1255/2510] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:46 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:26:46.485090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.488861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.509959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e18a4-5288-41c0-9955-a9d6df1f4b7b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.516879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.517530 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.517856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.518172 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.519205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.520350 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:46.520828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.533998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1256/2511] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:46.540000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.553358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49481f-93b8-4191-802e-7ff22c8ad3e1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.561793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.562476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.562750 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.563020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.563722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.565311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.575006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515714c1-1feb-4d79-9a43-d38a95a73d1d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.581077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1257/2512] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:46.581246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d13a6-3215-4691-8722-3425d22def68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.581246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d13a6-3215-4691-8722-3425d22def68 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.581246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d13a6-3215-4691-8722-3425d22def68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.581246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d13a6-3215-4691-8722-3425d22def68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.583438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.590919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d13a6-3215-4691-8722-3425d22def68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.592520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d13a6-3215-4691-8722-3425d22def68 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.603261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891fd3-6e7a-4188-87b2-49ed8328ecfb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:46.611151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:46.612190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.613128 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.613529 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] PATH_INFO: `/v3/projects/42d5da67c84444528c8a20acb9fba2c1/users/2288d60188f4444597245e56c6acbebd/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.614332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1256/2513] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:46.651485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d5da67c84444528c8a20acb9fba2c1, user_id=2288d60188f4444597245e56c6acbebd, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:46.654366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:46.678797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1258/2514] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:46 2022] PUT /identity/v3/projects/42d5da67c84444528c8a20acb9fba2c1/users/2288d60188f4444597245e56c6acbebd/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:46.689073 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d9872-f1e7-46e5-8a07-f0c5eb82a295 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:46.689676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d9872-f1e7-46e5-8a07-f0c5eb82a295 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:46.690263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d9872-f1e7-46e5-8a07-f0c5eb82a295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:46.726908 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-552d9872-f1e7-46e5-8a07-f0c5eb82a295 None None] MFA Rules not processed for user `2288d60188f4444597245e56c6acbebd`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:46.728661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-552d9872-f1e7-46e5-8a07-f0c5eb82a295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.843209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1257/2515] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:46.882984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:46.884729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:46.939929 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:46.996606 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e9483d-feba-4500-bca7-c42291d858d3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:47.002420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd4686-4eec-477b-96d4-ac0125867876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:47.003223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4686-4eec-477b-96d4-ac0125867876 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:47.003599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4686-4eec-477b-96d4-ac0125867876 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:47.003982 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd4686-4eec-477b-96d4-ac0125867876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:47.013527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd4686-4eec-477b-96d4-ac0125867876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:47.015355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd4686-4eec-477b-96d4-ac0125867876 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:47.025974 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1259/2516] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:52.380421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d9872-f1e7-46e5-8a07-f0c5eb82a295 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:52.449219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d9872-f1e7-46e5-8a07-f0c5eb82a295 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:52.454282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:52.454959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:52.455244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:52.455521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] PATH_INFO: `/v3/users/2288d60188f4444597245e56c6acbebd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:52.456739 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2288d60188f4444597245e56c6acbebd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:52.458732 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:52.507008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2288d60188f4444597245e56c6acbebd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:52.512179 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:52.516571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2288d60188f4444597245e56c6acbebd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:52.517704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2288d60188f4444597245e56c6acbebd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:52.531130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2288d60188f4444597245e56c6acbebd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:52.541425 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2288d60188f4444597245e56c6acbebd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:52.548000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1258/2517] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:52 2022] DELETE /identity/v3/users/2288d60188f4444597245e56c6acbebd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:52.553111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:52.553630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:52.553735 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:52.572644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:52.573883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:52.636572 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1260/2518] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:52.647256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:52.648772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:52.707340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f9894-cc07-43a8-9bb1-cf27b5f70f5b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:52.710995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1bb16a-6da3-433d-90bc-e0042cad4552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:52.711623 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb16a-6da3-433d-90bc-e0042cad4552 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:52.711903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb16a-6da3-433d-90bc-e0042cad4552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:52.712182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1bb16a-6da3-433d-90bc-e0042cad4552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:52.721345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb16a-6da3-433d-90bc-e0042cad4552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:52.722833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1bb16a-6da3-433d-90bc-e0042cad4552 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:52.732975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1259/2519] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:53.014518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.016130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.029105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817721f4-e34c-4202-8f3f-676a22ed5ec9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.034607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.035115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.035437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.035714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] PATH_INFO: `/v3/projects/42d5da67c84444528c8a20acb9fba2c1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.036890 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d5da67c84444528c8a20acb9fba2c1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.038911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.100864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d5da67c84444528c8a20acb9fba2c1', 'request_id': 'req-14a9ba65-c21e-44eb-808a-5c40af8d8af9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:53.109879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d5da67c84444528c8a20acb9fba2c1', 'request_id': 'req-14a9ba65-c21e-44eb-808a-5c40af8d8af9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:53.117392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d5da67c84444528c8a20acb9fba2c1', 'request_id': 'req-14a9ba65-c21e-44eb-808a-5c40af8d8af9'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:53.129432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] The token cache is being invalidate because project 42d5da67c84444528c8a20acb9fba2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:53.129721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:53.130492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:53.132185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1261/2520] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:53 2022] DELETE /identity/v3/projects/42d5da67c84444528c8a20acb9fba2c1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:53.137296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259dda9-2d1e-4f55-b977-b5adcc97d395 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.137577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259dda9-2d1e-4f55-b977-b5adcc97d395 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.137841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259dda9-2d1e-4f55-b977-b5adcc97d395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.157845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5259dda9-2d1e-4f55-b977-b5adcc97d395 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:53.159253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5259dda9-2d1e-4f55-b977-b5adcc97d395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.204487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.206044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.248551 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1260/2521] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:53.250931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3e2c-e649-47ab-960a-80874423d00f None None] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.251269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3e2c-e649-47ab-960a-80874423d00f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.251628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf3e2c-e649-47ab-960a-80874423d00f None None] PATH_INFO: `/` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.253012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1261/2522] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:26:53.254039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:53.256570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c3f41-8868-44d6-80c0-afb1aa326351 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.256929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c3f41-8868-44d6-80c0-afb1aa326351 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.259047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c3f41-8868-44d6-80c0-afb1aa326351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.281303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-9b0c3f41-8868-44d6-80c0-afb1aa326351 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:53.282647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-9b0c3f41-8868-44d6-80c0-afb1aa326351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.295480 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1262/2523] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:53.296888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd22b32-326f-455b-b631-4dda1b427f22 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.297174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd22b32-326f-455b-b631-4dda1b427f22 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.297451 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd22b32-326f-455b-b631-4dda1b427f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.304236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9ba65-c21e-44eb-808a-5c40af8d8af9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.311604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.312247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.312555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.312800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.315880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.325050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-fcd22b32-326f-455b-b631-4dda1b427f22 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:53.327331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fcd22b32-326f-455b-b631-4dda1b427f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.342710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1263/2524] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:53.349223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd22b32-326f-455b-b631-4dda1b427f22 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.361409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd22b32-326f-455b-b631-4dda1b427f22 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.366597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.367237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.367531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.367798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.368503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:53.368813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.370546 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.389252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1264/2525] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:53.391322 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.394065 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.412550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.419747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.431698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1262/2526] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:53.432358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.453390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a968cee-66d2-4d84-a97d-a7f87d1041b0 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.468312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.468967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.469246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.469523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.470255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.472191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.498834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:53.523510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac9546-a1fa-45f3-b64b-86b9c41e1db9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.524644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1263/2527] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:53 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:53.528975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.600505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.601252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.601483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.601760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.610684 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363703f8-228b-47f6-9db0-16f017a3cade admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.616043 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.616820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.617273 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.617597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.618345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.620436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.643679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1264/2528] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:53 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:53.647783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.662135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625cac01-8097-4b68-9b4e-c4dc33f3574e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.664492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.665110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.665504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.665916 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.666837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.668849 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.677594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.679195 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.683316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1265/2529] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:26:53.684616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.690848 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1265/2530] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:53.695015 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22255cd-9401-4f45-9e39-83ddca45d945 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.700976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14df4fa-7621-4d97-ac8f-9ead5518c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.701630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df4fa-7621-4d97-ac8f-9ead5518c236 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.701906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df4fa-7621-4d97-ac8f-9ead5518c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.702205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df4fa-7621-4d97-ac8f-9ead5518c236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.702934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14df4fa-7621-4d97-ac8f-9ead5518c236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.704588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14df4fa-7621-4d97-ac8f-9ead5518c236 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.715177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1266/2531] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:26:53.719426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.733414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5af78c-738d-4d7f-a136-2365e81ec288 service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.751126 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a7b7b-99e3-4fa1-bf06-9fbb1f24bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.752420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a7b7b-99e3-4fa1-bf06-9fbb1f24bdab admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.752420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a7b7b-99e3-4fa1-bf06-9fbb1f24bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.752725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a7b7b-99e3-4fa1-bf06-9fbb1f24bdab admin admin] PATH_INFO: `/v3/projects/c52ab7bbf7fc4d00a6087767e3c84dd1/users/4286bd9c0ae14e04947390d6a7c1ddbb/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.777513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a7b7b-99e3-4fa1-bf06-9fbb1f24bdab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52ab7bbf7fc4d00a6087767e3c84dd1, user_id=4286bd9c0ae14e04947390d6a7c1ddbb, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.780427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396a9e-7a05-43dc-a797-074b8b264d56 None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.780712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396a9e-7a05-43dc-a797-074b8b264d56 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.780989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c396a9e-7a05-43dc-a797-074b8b264d56 None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.781146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a7b7b-99e3-4fa1-bf06-9fbb1f24bdab admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.782665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1267/2532] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 06 01:26:53.787915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.788478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.788871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.817844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1266/2533] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:53 2022] PUT /identity/v3/projects/c52ab7bbf7fc4d00a6087767e3c84dd1/users/4286bd9c0ae14e04947390d6a7c1ddbb/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:53.821000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.821351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.821687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.832818 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] MFA Rules not processed for user `ed70b6997f064f3f8fa68dea2a6eb470`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:53.834264 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.849174 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:53.851724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] MFA Rules not processed for user `4286bd9c0ae14e04947390d6a7c1ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:53.852951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.896706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1268/2534] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:53.909667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.911198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.922426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052e02e-e3b9-4c82-b434-00e789b406b7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:53.926279 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96582a74-a671-4798-8f5d-e256bf7837ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:53.926902 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582a74-a671-4798-8f5d-e256bf7837ff service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:53.927177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582a74-a671-4798-8f5d-e256bf7837ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:53.927449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96582a74-a671-4798-8f5d-e256bf7837ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:53.934024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1267/2535] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:53.935020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96582a74-a671-4798-8f5d-e256bf7837ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:53.936522 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96582a74-a671-4798-8f5d-e256bf7837ff service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:53.943742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:53.945226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:53.945715 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1269/2536] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:53.956132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:54.027186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389488b-7d8b-4cf5-8222-f1a21df12ed3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:54.035133 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac73f80-ee1d-4791-95a7-0979a1dc67fe None None] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:54.035423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac73f80-ee1d-4791-95a7-0979a1dc67fe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:54.035699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac73f80-ee1d-4791-95a7-0979a1dc67fe None None] PATH_INFO: `/` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:54.037676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1270/2537] 10.222.0.17 () {54 vars in 921 bytes} [Sat Aug 6 01:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 06 01:26:54.039520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:54.040237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:54.040522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:54.040796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:54.043260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083594d2-8101-440a-ace5-b8869d89c2c9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:54.043537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083594d2-8101-440a-ace5-b8869d89c2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:54.043808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083594d2-8101-440a-ace5-b8869d89c2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:54.053719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:54.055383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:54.066321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1268/2538] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:54.076343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-083594d2-8101-440a-ace5-b8869d89c2c9 None None] MFA Rules not processed for user `2d0553dc133749eab4777d6552a93178`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:54.077625 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-083594d2-8101-440a-ace5-b8869d89c2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:54.089260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1271/2539] 10.222.0.17 () {58 vars in 1018 bytes} [Sat Aug 6 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:54.101753 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:54.103990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:54.118333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76e53f-b77b-450a-a265-830681ce909e service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:54.122199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707aada-6fd2-42d1-9dd9-557b4554c764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:54.122887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707aada-6fd2-42d1-9dd9-557b4554c764 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:54.123236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707aada-6fd2-42d1-9dd9-557b4554c764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:54.123575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707aada-6fd2-42d1-9dd9-557b4554c764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:54.135212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707aada-6fd2-42d1-9dd9-557b4554c764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:54.137296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707aada-6fd2-42d1-9dd9-557b4554c764 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:54.149423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1269/2540] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:57.051211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083594d2-8101-440a-ace5-b8869d89c2c9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:57.122157 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083594d2-8101-440a-ace5-b8869d89c2c9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:57.126574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:57.127224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:57.127515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:57.127773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] PATH_INFO: `/v3/users/4286bd9c0ae14e04947390d6a7c1ddbb` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:57.128947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4286bd9c0ae14e04947390d6a7c1ddbb)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:57.130979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:57.186382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4286bd9c0ae14e04947390d6a7c1ddbb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.205499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4286bd9c0ae14e04947390d6a7c1ddbb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.225394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4286bd9c0ae14e04947390d6a7c1ddbb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.226257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4286bd9c0ae14e04947390d6a7c1ddbb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.235027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4286bd9c0ae14e04947390d6a7c1ddbb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.240909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1272/2541] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:57 2022] DELETE /identity/v3/users/4286bd9c0ae14e04947390d6a7c1ddbb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:57.245331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53160e4-44f5-45d6-8a06-a25b798a23e0 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:57.245805 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53160e4-44f5-45d6-8a06-a25b798a23e0 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:57.246022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53160e4-44f5-45d6-8a06-a25b798a23e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:57.270310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-a53160e4-44f5-45d6-8a06-a25b798a23e0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:57.272367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a53160e4-44f5-45d6-8a06-a25b798a23e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:57.367557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1270/2542] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:57.377575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:57.379042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:57.410223 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:57.437872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbc218-9e53-4b9b-8f79-cddd9b31ccad admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:57.441477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:57.442125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:57.442424 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:57.442673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:57.451877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:57.453315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:57.463433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1273/2543] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:57.553832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:57.554143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:57.554435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:57.575680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:57.576912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:57.646904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1271/2544] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:57.660704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:57.662231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:57.741825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51097a-aba8-4167-b0fa-3adab81b7643 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:57.747242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcced760-adbf-4a33-bb15-1e38ef1f9fcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:57.747957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced760-adbf-4a33-bb15-1e38ef1f9fcf service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:57.748217 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced760-adbf-4a33-bb15-1e38ef1f9fcf service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:57.748485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcced760-adbf-4a33-bb15-1e38ef1f9fcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:57.756885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:57.758937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:57.766275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcced760-adbf-4a33-bb15-1e38ef1f9fcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:57.768276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcced760-adbf-4a33-bb15-1e38ef1f9fcf service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:57.785802 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62f631-5c90-4aaa-a2ae-e8efab5409ea None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:57.788420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1274/2545] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:26:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:26:57.804733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:57.805419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:57.805700 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:57.806017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] PATH_INFO: `/v3/projects/c52ab7bbf7fc4d00a6087767e3c84dd1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:57.811338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52ab7bbf7fc4d00a6087767e3c84dd1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:57.813517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:57.841166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:57.879485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52ab7bbf7fc4d00a6087767e3c84dd1', 'request_id': 'req-0f38c8a6-88e0-4770-830e-4090d8882408'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.894286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52ab7bbf7fc4d00a6087767e3c84dd1', 'request_id': 'req-0f38c8a6-88e0-4770-830e-4090d8882408'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.905596 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52ab7bbf7fc4d00a6087767e3c84dd1', 'request_id': 'req-0f38c8a6-88e0-4770-830e-4090d8882408'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.931108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] The token cache is being invalidate because project c52ab7bbf7fc4d00a6087767e3c84dd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:26:57.931565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.933583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0f38c8a6-88e0-4770-830e-4090d8882408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:57.943357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1272/2546] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:57 2022] DELETE /identity/v3/projects/c52ab7bbf7fc4d00a6087767e3c84dd1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:57.949689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4cd01-65aa-4bfa-8f14-f8250a7a050c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:57.950712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4cd01-65aa-4bfa-8f14-f8250a7a050c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:57.951579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4cd01-65aa-4bfa-8f14-f8250a7a050c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:57.988602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-16b4cd01-65aa-4bfa-8f14-f8250a7a050c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:57.990272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-16b4cd01-65aa-4bfa-8f14-f8250a7a050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:58.081433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1275/2547] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:58.090479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82cadc-3357-4fc0-a9f3-942a45900b41 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.091295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82cadc-3357-4fc0-a9f3-942a45900b41 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.091936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e82cadc-3357-4fc0-a9f3-942a45900b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.121562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6e82cadc-3357-4fc0-a9f3-942a45900b41 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:58.123242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6e82cadc-3357-4fc0-a9f3-942a45900b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:58.132738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1273/2548] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:58.149407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4cd01-65aa-4bfa-8f14-f8250a7a050c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.159959 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4cd01-65aa-4bfa-8f14-f8250a7a050c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.166180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.169706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.169706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.169706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.169706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:26:58.169706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.170416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.189065 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1276/2549] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:26:58.189772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82cadc-3357-4fc0-a9f3-942a45900b41 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.202146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e82cadc-3357-4fc0-a9f3-942a45900b41 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.226352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.227454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.227970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.228648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.230272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.232673 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.278228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1274/2550] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:58 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:26:58.290038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.305759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ae0c8-f4dc-494b-b291-1751e54b0820 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.367757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:58.386206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.387179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.387643 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.388068 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.388894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.391404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.427841 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1277/2551] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:58 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:58.433821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.448697 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0a1d-e5bb-49da-81bb-400805e4e3fd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.459427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.460231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.460979 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.461454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.462403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.464265 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.498928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1275/2552] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:58.503532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.517222 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3cf9a-c5bd-4af9-bda2-6e2d3ee10a94 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.538201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1f521-009e-4425-822e-9fb3e3e375d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.539007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f521-009e-4425-822e-9fb3e3e375d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.539289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f521-009e-4425-822e-9fb3e3e375d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.539563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1f521-009e-4425-822e-9fb3e3e375d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.541077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1f521-009e-4425-822e-9fb3e3e375d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.542822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1f521-009e-4425-822e-9fb3e3e375d5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.566395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1278/2553] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:58.568133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.587212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c8959-5f8f-407e-8c47-c99e15f5743d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.611781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.612488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.612772 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.613048 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] PATH_INFO: `/v3/projects/50b4a29f73c746a5b45cc04ad5ab33fd/users/b89ced9c455649bbb4049f90ea6ac2bf/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.652422 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b4a29f73c746a5b45cc04ad5ab33fd, user_id=b89ced9c455649bbb4049f90ea6ac2bf, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.655468 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.676906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1276/2554] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:58 2022] PUT /identity/v3/projects/50b4a29f73c746a5b45cc04ad5ab33fd/users/b89ced9c455649bbb4049f90ea6ac2bf/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:58.688106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76df80-432b-4ecd-b798-9d483ae89719 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.688397 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76df80-432b-4ecd-b798-9d483ae89719 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.688675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76df80-432b-4ecd-b798-9d483ae89719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.706788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.708906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:58.756923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-be76df80-432b-4ecd-b798-9d483ae89719 None None] MFA Rules not processed for user `b89ced9c455649bbb4049f90ea6ac2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:58.758362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-be76df80-432b-4ecd-b798-9d483ae89719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:58.849605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21786cf5-be7f-486c-adf4-97481e17d752 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.855765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.856443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.856727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.857003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] PATH_INFO: `/v3/users/0a6e068821a2439789b748dcb207c61b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.858601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6e068821a2439789b748dcb207c61b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.860746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.884937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1279/2555] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:58.890041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76df80-432b-4ecd-b798-9d483ae89719 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.919049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76df80-432b-4ecd-b798-9d483ae89719 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:58.924767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:58.925698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:58.925994 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:58.926269 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:58.927061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:58.929370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:58.972642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6e068821a2439789b748dcb207c61b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:58.975063 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:58.977363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1280/2556] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:26:58 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:58.981837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:58.988944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6e068821a2439789b748dcb207c61b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:58.990160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6e068821a2439789b748dcb207c61b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:59.031196 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6e068821a2439789b748dcb207c61b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:59.054212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-579146eb-c2c3-40b3-80c4-a5293ca1d92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6e068821a2439789b748dcb207c61b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:26:59.061024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1277/2557] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:26:58 2022] DELETE /identity/v3/users/0a6e068821a2439789b748dcb207c61b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:59.065831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.066253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.066638 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.085921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97fe3c-f966-4fea-9434-03ef94a4435a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.091068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:59.092521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:59.127087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:59.147539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.148184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.148458 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.148726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.149537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.151677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.174061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1278/2558] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:26:59.185369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:59.189837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1281/2559] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:26:58 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:26:59.190609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:59.190939 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:59.192721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:59.208237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f806d-890b-4b0b-a0f3-fdeda232bb47 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.213051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.213759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.214128 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.214404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.215117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.216734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.234501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1282/2560] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:59.235951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:59.248823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41807e0-aacc-4dac-a421-34f539368702 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.253911 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.254276 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.254552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.254823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] PATH_INFO: `/v3/projects/c1110647382847ee874819a209054a6c/users/1658276a98b549aa88405b5f328d0d3b/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.272691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1110647382847ee874819a209054a6c, user_id=1658276a98b549aa88405b5f328d0d3b, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.275534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.282232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fbff9-d3f7-4d4e-8aec-1091ec3cbb46 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.287119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.287773 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.288059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.288338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.297346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1283/2561] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:59 2022] PUT /identity/v3/projects/c1110647382847ee874819a209054a6c/users/1658276a98b549aa88405b5f328d0d3b/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:26:59.300092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.301720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:59.302240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.315312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1279/2562] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:26:59.409233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa9e7-093e-4b45-887d-f423f34d6d2e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.414584 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bf7b4-eb52-4dfb-95cc-fa2747d2773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.415306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bf7b4-eb52-4dfb-95cc-fa2747d2773f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.415634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bf7b4-eb52-4dfb-95cc-fa2747d2773f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.416022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bf7b4-eb52-4dfb-95cc-fa2747d2773f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.426478 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bf7b4-eb52-4dfb-95cc-fa2747d2773f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.436070 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269bf7b4-eb52-4dfb-95cc-fa2747d2773f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.459893 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1284/2563] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:26:59.461246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:59.481167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf779f7-646b-4a16-ae88-2395c8b59d12 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.491311 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.507711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.508097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.508376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] PATH_INFO: `/v3/projects/c1110647382847ee874819a209054a6c/users/1658276a98b549aa88405b5f328d0d3b/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.511892 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1110647382847ee874819a209054a6c, user_id=1658276a98b549aa88405b5f328d0d3b, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.515446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.558655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1280/2564] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:26:59 2022] PUT /identity/v3/projects/c1110647382847ee874819a209054a6c/users/1658276a98b549aa88405b5f328d0d3b/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:26:59.570386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.570759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.571101 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.611552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] MFA Rules not processed for user `1658276a98b549aa88405b5f328d0d3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:59.612897 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:59.682770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:59.686455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:59.717190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1285/2565] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:26:59.731262 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:26:59.733467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:26:59.786774 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:59.866348 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:26:59.878510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f32095-8d32-43c2-9c72-c501bff2a09b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.891130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7007b31-7b78-4f2a-ae32-45f7a6f0dd92 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:26:59.892455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.893763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.894429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.894781 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] PATH_INFO: `/v3/projects/4ae5107603fd49b89a2671a227c1e1e8` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.895918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e74a-f4d2-4acd-bb9d-b2c4172caf7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:26:59.896192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae5107603fd49b89a2671a227c1e1e8)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.896559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e74a-f4d2-4acd-bb9d-b2c4172caf7f service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.896830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e74a-f4d2-4acd-bb9d-b2c4172caf7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.897104 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e74a-f4d2-4acd-bb9d-b2c4172caf7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.898627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.916596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4e74a-f4d2-4acd-bb9d-b2c4172caf7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:26:59.918210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4e74a-f4d2-4acd-bb9d-b2c4172caf7f service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:26:59.938830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1286/2566] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:26:59.940136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a342e-82c7-4b3d-bddd-12e7d7ec1a7c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:26:59.940422 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a342e-82c7-4b3d-bddd-12e7d7ec1a7c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:26:59.940731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a342e-82c7-4b3d-bddd-12e7d7ec1a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:26:59.961505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c60a342e-82c7-4b3d-bddd-12e7d7ec1a7c None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:26:59.962412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c60a342e-82c7-4b3d-bddd-12e7d7ec1a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.014511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae5107603fd49b89a2671a227c1e1e8', 'request_id': 'req-5b8125bb-fbcc-4662-8dc8-55af247e389c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.039506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae5107603fd49b89a2671a227c1e1e8', 'request_id': 'req-5b8125bb-fbcc-4662-8dc8-55af247e389c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.047762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae5107603fd49b89a2671a227c1e1e8', 'request_id': 'req-5b8125bb-fbcc-4662-8dc8-55af247e389c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.061562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] The token cache is being invalidate because project 4ae5107603fd49b89a2671a227c1e1e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:00.062258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.066687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.069479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1281/2567] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:26:59 2022] DELETE /identity/v3/projects/4ae5107603fd49b89a2671a227c1e1e8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:00.074207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.076010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.085454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1287/2568] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:26:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:00.086709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.087305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.087305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.127225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:00.128461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.164317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8125bb-fbcc-4662-8dc8-55af247e389c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.170628 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.171500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.172386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.172831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] PATH_INFO: `/v3/users/b89ced9c455649bbb4049f90ea6ac2bf` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.174636 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89ced9c455649bbb4049f90ea6ac2bf)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.178255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.193811 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1288/2569] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:00.194947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.199230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.242631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89ced9c455649bbb4049f90ea6ac2bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.257973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89ced9c455649bbb4049f90ea6ac2bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.257973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89ced9c455649bbb4049f90ea6ac2bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.272403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89ced9c455649bbb4049f90ea6ac2bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.284589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0037f0b0-3a2f-4fd3-a2c1-500ffaf1220d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89ced9c455649bbb4049f90ea6ac2bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:00.296502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1282/2570] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:00 2022] DELETE /identity/v3/users/b89ced9c455649bbb4049f90ea6ac2bf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:00.298913 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9e7c-6798-408e-a8c4-ac1af7a5ad47 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.299301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9e7c-6798-408e-a8c4-ac1af7a5ad47 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.299608 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e9e7c-6798-408e-a8c4-ac1af7a5ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.311157 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:00.323549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248638c-3f7a-40e1-8d32-3f09f1476af8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.330166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:00.331806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ea6e9e7c-6798-408e-a8c4-ac1af7a5ad47 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:00.336731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ea6e9e7c-6798-408e-a8c4-ac1af7a5ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.395627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.396203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.396546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.396891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.399053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.435978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1283/2571] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:00.435978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742433e0-eedc-48cd-950d-1132999a20fd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.435978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742433e0-eedc-48cd-950d-1132999a20fd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.435978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742433e0-eedc-48cd-950d-1132999a20fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.454640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-742433e0-eedc-48cd-950d-1132999a20fd None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:00.456150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-742433e0-eedc-48cd-950d-1132999a20fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.465601 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1284/2572] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:00.470282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742433e0-eedc-48cd-950d-1132999a20fd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.482165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742433e0-eedc-48cd-950d-1132999a20fd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.487261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.488050 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.488338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.488712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.489595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:00.490182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.491962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.512644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1285/2573] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:00.512644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.512644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:00.522819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.524449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.534920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1289/2574] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:27:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:27:00.535747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.547648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de4b4e-c205-4335-a8fc-be4f9c430836 service swift] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.554169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.554840 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.555114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.555383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.556051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.558201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.587449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13029603-beeb-4698-9b16-d789da2945f3 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.591663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.592457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.593051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.593810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.605906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.610124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1290/2575] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:00 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:00.611580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.615832 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.630961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1286/2576] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:00.739169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d4d3-31cb-4c21-a600-b3c51433a101 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.750407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.752177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.752784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.753207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.754823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.757515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.810945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1291/2577] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:00 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:00.815522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.836747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647c7f-efc6-49f9-a034-36690646d7c1 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.842536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.849169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.849405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.849723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.850587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.852648 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.880652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1287/2578] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:00.885312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.902414 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e7afe-1dc4-4dfb-96fd-1f7b83c000fd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.914592 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3e618-e447-4c4f-a5fb-fd4479eba3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.916621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3e618-e447-4c4f-a5fb-fd4479eba3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.916967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3e618-e447-4c4f-a5fb-fd4479eba3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.923360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3e618-e447-4c4f-a5fb-fd4479eba3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:00.924582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3e618-e447-4c4f-a5fb-fd4479eba3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:00.926869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3e618-e447-4c4f-a5fb-fd4479eba3c4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:00.955398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1292/2579] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:00.956708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:00.974641 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0f3a-063a-4a25-852a-402158d081c7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:00.987053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:00.988585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:00.989097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:00.989509 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] PATH_INFO: `/v3/projects/9683f172af424c649ab3c404d864e938/users/5974a9b4b7164d1f8561f9bb6be0356b/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:01.042393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9683f172af424c649ab3c404d864e938, user_id=5974a9b4b7164d1f8561f9bb6be0356b, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:01.046093 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:01.067332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1288/2580] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:00 2022] PUT /identity/v3/projects/9683f172af424c649ab3c404d864e938/users/5974a9b4b7164d1f8561f9bb6be0356b/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:01.085790 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaac711-cc52-451e-b0d9-dd3fb6a492ac None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:01.086509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaac711-cc52-451e-b0d9-dd3fb6a492ac None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:01.087338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaac711-cc52-451e-b0d9-dd3fb6a492ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:01.094347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:01.096794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:01.116206 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:01.179468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6eaac711-cc52-451e-b0d9-dd3fb6a492ac None None] MFA Rules not processed for user `5974a9b4b7164d1f8561f9bb6be0356b`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:01.183351 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6eaac711-cc52-451e-b0d9-dd3fb6a492ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:01.235478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:01.273386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b861e-16f3-48ec-8808-4f74a1c6f466 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:01.289996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:01.294991 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:01.295479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:01.295874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] PATH_INFO: `/v3/projects/50b4a29f73c746a5b45cc04ad5ab33fd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:01.297520 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b4a29f73c746a5b45cc04ad5ab33fd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:01.301403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:01.362074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1293/2581] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:01.411009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b4a29f73c746a5b45cc04ad5ab33fd', 'request_id': 'req-e3cef996-a9a0-4c53-8308-f1762cdb29cd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.422162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b4a29f73c746a5b45cc04ad5ab33fd', 'request_id': 'req-e3cef996-a9a0-4c53-8308-f1762cdb29cd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.431365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b4a29f73c746a5b45cc04ad5ab33fd', 'request_id': 'req-e3cef996-a9a0-4c53-8308-f1762cdb29cd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.454668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] The token cache is being invalidate because project 50b4a29f73c746a5b45cc04ad5ab33fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:01.455259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.456045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.461871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1289/2582] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:01 2022] DELETE /identity/v3/projects/50b4a29f73c746a5b45cc04ad5ab33fd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:01.462776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaac711-cc52-451e-b0d9-dd3fb6a492ac None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:01.484733 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaac711-cc52-451e-b0d9-dd3fb6a492ac None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:01.585549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:01.586189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:01.586714 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:01.587001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] PATH_INFO: `/v3/users/1658276a98b549aa88405b5f328d0d3b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:01.588236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1658276a98b549aa88405b5f328d0d3b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:01.590502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:01.661875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1658276a98b549aa88405b5f328d0d3b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.676730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1658276a98b549aa88405b5f328d0d3b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.698541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1658276a98b549aa88405b5f328d0d3b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.699441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1658276a98b549aa88405b5f328d0d3b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.708188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-07b49c6a-645b-4481-93c9-5a69f5e10ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1658276a98b549aa88405b5f328d0d3b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:01.719378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1294/2583] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:01 2022] DELETE /identity/v3/users/1658276a98b549aa88405b5f328d0d3b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:02.204725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:02.206717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:02.250889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cef996-a9a0-4c53-8308-f1762cdb29cd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:02.374661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:02.375869 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:02.376285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:02.376701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] PATH_INFO: `/v3/projects/c1110647382847ee874819a209054a6c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:02.378789 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1110647382847ee874819a209054a6c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:02.382205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:02.459310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1110647382847ee874819a209054a6c', 'request_id': 'req-30616747-fce1-49cd-bd54-f6266a2fed34'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:02.476935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1110647382847ee874819a209054a6c', 'request_id': 'req-30616747-fce1-49cd-bd54-f6266a2fed34'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:02.486597 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1110647382847ee874819a209054a6c', 'request_id': 'req-30616747-fce1-49cd-bd54-f6266a2fed34'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:02.500847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] The token cache is being invalidate because project c1110647382847ee874819a209054a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:02.501143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:02.501836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-30616747-fce1-49cd-bd54-f6266a2fed34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:02.503588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1290/2584] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:02 2022] DELETE /identity/v3/projects/c1110647382847ee874819a209054a6c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:02.508992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871318-845a-4829-8b52-ad4e15689497 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:02.509451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871318-845a-4829-8b52-ad4e15689497 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:02.509815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b871318-845a-4829-8b52-ad4e15689497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:02.553270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2b871318-845a-4829-8b52-ad4e15689497 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:02.554772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2b871318-845a-4829-8b52-ad4e15689497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:02.582240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:02.654280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1295/2585] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:02.656152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24584fe-c134-4ab5-a00a-6c4cc08909e3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:02.656448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24584fe-c134-4ab5-a00a-6c4cc08909e3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:02.659102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24584fe-c134-4ab5-a00a-6c4cc08909e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:02.718352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c24584fe-c134-4ab5-a00a-6c4cc08909e3 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:02.721731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c24584fe-c134-4ab5-a00a-6c4cc08909e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:02.754312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1291/2586] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:02.756317 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b871318-845a-4829-8b52-ad4e15689497 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:02.777550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b871318-845a-4829-8b52-ad4e15689497 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:02.794129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:02.795949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:02.797348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:02.797639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:02.800621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:02.800947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:02.805698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:02.843782 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1296/2587] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:02.845852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24584fe-c134-4ab5-a00a-6c4cc08909e3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:02.857626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24584fe-c134-4ab5-a00a-6c4cc08909e3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:02.867970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:02.868626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:02.874825 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:02.875174 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:02.875918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:02.877901 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:02.889334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:02.954686 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1292/2588] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:02 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:02.959256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:02.976102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525b917-9006-4582-9cb3-a54d3929ac3a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:03.082338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:03.083771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:03.084321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:03.084603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:03.085352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:03.087486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:03.114003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1297/2589] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:02 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:03.117439 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:03.131977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8cc39-df28-440c-888d-09b62e5789e4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:03.233141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:03.233141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:03.233141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:03.233141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:03.246229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:03.246229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:03.314014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1293/2590] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:03.316022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:03.353677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de503cdd-dda5-4f0e-980f-89e25b8cf013 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:03.362934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37518a4-9618-4c8d-a110-07af0c692cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:03.363871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37518a4-9618-4c8d-a110-07af0c692cff admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:03.364326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37518a4-9618-4c8d-a110-07af0c692cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:03.365017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37518a4-9618-4c8d-a110-07af0c692cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:03.366310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37518a4-9618-4c8d-a110-07af0c692cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:03.368417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37518a4-9618-4c8d-a110-07af0c692cff admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:03.381284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1298/2591] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:03.385743 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:03.397605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b05534-1db5-4d08-ba1e-13df61d4c89e admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:03.402844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:03.403714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:03.404106 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:03.404476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] PATH_INFO: `/v3/projects/8f09c884d9ff46c5b5207124683a2c6f/users/29b46f84729546bcbf593ee45c1470f1/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:03.423423 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f09c884d9ff46c5b5207124683a2c6f, user_id=29b46f84729546bcbf593ee45c1470f1, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:03.426557 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:03.450481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1294/2592] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:03 2022] PUT /identity/v3/projects/8f09c884d9ff46c5b5207124683a2c6f/users/29b46f84729546bcbf593ee45c1470f1/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:03.462677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a368-85b3-44e7-a6ca-74184e8e04ff None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:03.463261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a368-85b3-44e7-a6ca-74184e8e04ff None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:03.463724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a368-85b3-44e7-a6ca-74184e8e04ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:03.534460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d727a368-85b3-44e7-a6ca-74184e8e04ff None None] MFA Rules not processed for user `29b46f84729546bcbf593ee45c1470f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:03.537465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d727a368-85b3-44e7-a6ca-74184e8e04ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:03.683962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1299/2593] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:03.689138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:03.812562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346c43-a97f-494e-bf6a-9862084c748a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:03.817698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:03.818556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:03.819029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:03.819458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:03.820275 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:03.822454 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:03.853380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1295/2594] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:03 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:03.857698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a368-85b3-44e7-a6ca-74184e8e04ff None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:03.869376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a368-85b3-44e7-a6ca-74184e8e04ff None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:03.874569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:03.931404 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:03.932155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:03.932612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:03.932984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:03.933791 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:03.935920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:03.973306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1300/2595] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:03 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:03.974389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:03.978035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16a8c6-2e5f-4416-a448-f430411e2503 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:03.995173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:04.007247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.007895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.008173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.009955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:04.020775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:04.070886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1296/2596] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:04.075240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:04.095189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8721a2-14c7-4866-961f-b1337b9ca13e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:04.122820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c5e7b-5ed7-4ba0-8ee7-8a74faee2b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:04.123367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c5e7b-5ed7-4ba0-8ee7-8a74faee2b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.123644 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c5e7b-5ed7-4ba0-8ee7-8a74faee2b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.124014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c5e7b-5ed7-4ba0-8ee7-8a74faee2b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.124777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c5e7b-5ed7-4ba0-8ee7-8a74faee2b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:04.126580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c5e7b-5ed7-4ba0-8ee7-8a74faee2b93 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:04.147554 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1301/2597] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:04.153212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:04.175278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af2afb3-59dd-4f44-9da2-df67888d9ba9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:04.192730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:04.193703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.194072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.194958 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] PATH_INFO: `/v3/projects/00743259100a4b6bbb4ac927d823c7a5/users/794327db16ed440d870a97d54ea11afd/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.235943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00743259100a4b6bbb4ac927d823c7a5, user_id=794327db16ed440d870a97d54ea11afd, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:04.239364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:04.263556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1297/2598] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:04 2022] PUT /identity/v3/projects/00743259100a4b6bbb4ac927d823c7a5/users/794327db16ed440d870a97d54ea11afd/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:04.274662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159877-7848-487b-8a14-47f1b4b3783c None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.275162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159877-7848-487b-8a14-47f1b4b3783c None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.275532 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6159877-7848-487b-8a14-47f1b4b3783c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.312955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e6159877-7848-487b-8a14-47f1b4b3783c None None] MFA Rules not processed for user `794327db16ed440d870a97d54ea11afd`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:04.314452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e6159877-7848-487b-8a14-47f1b4b3783c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:04.418546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1302/2599] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:04.423359 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:04.586752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5d9e-eeba-47f3-afbd-9480544b134b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:04.603321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:04.607627 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.608921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.610578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.613247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:04.621414 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:04.648631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:04.733446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1298/2600] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:04 2022] POST /identity/v3/projects => generated 387 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:04.738944 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6159877-7848-487b-8a14-47f1b4b3783c None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:04.764315 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6159877-7848-487b-8a14-47f1b4b3783c None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:04.879363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:04.880868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.881431 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.882067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.883197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:04.886569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:04.927748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1303/2601] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:04 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:04.931764 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:04.944240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687aa84-aac3-4785-be65-4c4b0b111d25 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:04.950978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:04.951647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:04.951935 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:04.952213 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:04.953102 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:04.954868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:04.981458 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1299/2602] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:04.982979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:04.996658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5ea6a-554a-4192-b00c-cb1f9640656c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:05.005803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:05.007349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:05.007915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:05.008726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] PATH_INFO: `/v3/projects/a3185302b2014991b051740b3a700122/users/b7ae241ed2d7499a980b42eaf2ec085a/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:05.014961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:05.042866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3185302b2014991b051740b3a700122, user_id=b7ae241ed2d7499a980b42eaf2ec085a, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:05.049022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:05.070229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1304/2603] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:04 2022] PUT /identity/v3/projects/a3185302b2014991b051740b3a700122/users/b7ae241ed2d7499a980b42eaf2ec085a/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:05.075800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:05.090111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b884a9a-581e-453f-9541-e91cd7e0218f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:05.207187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22521644-de86-493d-a346-09b36dd9c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:05.207942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521644-de86-493d-a346-09b36dd9c39d admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:05.208310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521644-de86-493d-a346-09b36dd9c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:05.208882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22521644-de86-493d-a346-09b36dd9c39d admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:05.209650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22521644-de86-493d-a346-09b36dd9c39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:05.211671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22521644-de86-493d-a346-09b36dd9c39d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:05.234319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1300/2604] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:05.238225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:05.258385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97163d8-ad59-454b-bf1d-f066c825ca0a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:05.268468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:05.269418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:05.269986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:05.270667 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] PATH_INFO: `/v3/projects/a3185302b2014991b051740b3a700122/users/b7ae241ed2d7499a980b42eaf2ec085a/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:05.274215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3185302b2014991b051740b3a700122, user_id=b7ae241ed2d7499a980b42eaf2ec085a, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:05.278415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:05.326948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1305/2605] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:05 2022] PUT /identity/v3/projects/a3185302b2014991b051740b3a700122/users/b7ae241ed2d7499a980b42eaf2ec085a/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:05.330899 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:05.331636 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:05.332081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:05.435028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] MFA Rules not processed for user `b7ae241ed2d7499a980b42eaf2ec085a`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:05.436274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:05.580637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1301/2606] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:05.595318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:05.597284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:05.723731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5307f6-7a05-4ed8-8da4-65806343a113 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:05.731602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:05.732510 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:05.733138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:05.733603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:05.745203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:05.747295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:05.771932 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1306/2607] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:07.135890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:07.138024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:07.178165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ff34d-cf36-4117-999a-3ce6e44ffaad None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:07.194352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:07.197759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:07.198683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:07.204498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:07.333253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:07.338118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:07.340455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:07.366153 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1302/2608] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:09.243161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:09.245136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:09.316599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08e364-ce2b-4886-af21-16bc8a9ede05 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:09.321239 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:09.323666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:09.324030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:09.324378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:09.327255 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:09.403528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:09.404985 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:09.414477 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1307/2609] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:11.794893 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:11.804253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172d08b-3960-43de-970c-5b133bd6c10a service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:11.812762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60350a5-8eb4-411b-bccd-6fa0dce7f562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:11.813419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60350a5-8eb4-411b-bccd-6fa0dce7f562 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:11.813703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60350a5-8eb4-411b-bccd-6fa0dce7f562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:11.818834 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60350a5-8eb4-411b-bccd-6fa0dce7f562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:11.926062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60350a5-8eb4-411b-bccd-6fa0dce7f562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:11.928015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60350a5-8eb4-411b-bccd-6fa0dce7f562 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:11.952618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1303/2610] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:14.725007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:14.764665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:14.804641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2bdf6-a3e4-4ccc-ab33-506e4327a449 service glance] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:14.809885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:14.811116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:14.811536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:14.811967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] PATH_INFO: `/v3/users/29b46f84729546bcbf593ee45c1470f1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:14.813514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b46f84729546bcbf593ee45c1470f1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:14.815997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:14.866989 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b46f84729546bcbf593ee45c1470f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:14.882628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b46f84729546bcbf593ee45c1470f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:14.898604 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b46f84729546bcbf593ee45c1470f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:14.899883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b46f84729546bcbf593ee45c1470f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:14.914843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b46f84729546bcbf593ee45c1470f1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:14.922640 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1308/2611] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:14 2022] DELETE /identity/v3/users/29b46f84729546bcbf593ee45c1470f1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:14.927874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:14.928438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:14.928720 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:14.951404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:14.953040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:15.037226 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1304/2612] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:15.047114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:15.048630 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:15.114699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63255128-ed84-4ff7-9711-d380c0172a3f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:15.118446 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:15.119075 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:15.119398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:15.119578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:15.130969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:15.132921 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:15.150130 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1309/2613] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:15.488061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:15.489806 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:15.511113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b078887f-2fca-49f7-a48b-19172b87f11d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:15.517987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:15.518799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:15.519332 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:15.519691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] PATH_INFO: `/v3/projects/8f09c884d9ff46c5b5207124683a2c6f` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:15.521320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f09c884d9ff46c5b5207124683a2c6f)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:15.523434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:15.577572 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f09c884d9ff46c5b5207124683a2c6f', 'request_id': 'req-3abf67f9-a3a3-420f-b650-44492cad4ec2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.587312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f09c884d9ff46c5b5207124683a2c6f', 'request_id': 'req-3abf67f9-a3a3-420f-b650-44492cad4ec2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.593752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f09c884d9ff46c5b5207124683a2c6f', 'request_id': 'req-3abf67f9-a3a3-420f-b650-44492cad4ec2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.612708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] The token cache is being invalidate because project 8f09c884d9ff46c5b5207124683a2c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:15.613090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.615771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.619233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1305/2614] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:15 2022] DELETE /identity/v3/projects/8f09c884d9ff46c5b5207124683a2c6f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:15.623492 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:15.633842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4248e-85df-4ef4-9300-babdd3317a26 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:15.686402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:15.701374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:15.702374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:15.702723 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:15.703091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] PATH_INFO: `/v3/users/794327db16ed440d870a97d54ea11afd` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:15.704736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794327db16ed440d870a97d54ea11afd)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:15.706719 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:15.770725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794327db16ed440d870a97d54ea11afd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.780948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794327db16ed440d870a97d54ea11afd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.806859 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794327db16ed440d870a97d54ea11afd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.807947 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794327db16ed440d870a97d54ea11afd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.817549 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794327db16ed440d870a97d54ea11afd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:15.824261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1310/2615] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:15 2022] DELETE /identity/v3/users/794327db16ed440d870a97d54ea11afd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:16.151323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:16.153464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:16.169199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf67f9-a3a3-420f-b650-44492cad4ec2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:16.183694 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:16.384693 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:16.386323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:16.386323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:16.386323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] PATH_INFO: `/v3/projects/00743259100a4b6bbb4ac927d823c7a5` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:16.387873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00743259100a4b6bbb4ac927d823c7a5)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:16.389768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:16.449007 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00743259100a4b6bbb4ac927d823c7a5', 'request_id': 'req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.464465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00743259100a4b6bbb4ac927d823c7a5', 'request_id': 'req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.474800 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00743259100a4b6bbb4ac927d823c7a5', 'request_id': 'req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.493860 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] The token cache is being invalidate because project 00743259100a4b6bbb4ac927d823c7a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:16.494339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.495610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.501438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1306/2616] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:16 2022] DELETE /identity/v3/projects/00743259100a4b6bbb4ac927d823c7a5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:16.503066 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:16.504887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:16.522427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8039b-2e98-4362-aaf4-903491bb0656 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:16.592394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:16.593357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:16.593851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:16.594336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] PATH_INFO: `/v3/users/b7ae241ed2d7499a980b42eaf2ec085a` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:16.595602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ae241ed2d7499a980b42eaf2ec085a)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:16.597637 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:16.665605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ae241ed2d7499a980b42eaf2ec085a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.676229 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ae241ed2d7499a980b42eaf2ec085a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.689826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:16.692024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ae241ed2d7499a980b42eaf2ec085a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.692717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ae241ed2d7499a980b42eaf2ec085a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.707073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0279d61a-6d5c-416e-938c-9a47b3ca710e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ae241ed2d7499a980b42eaf2ec085a'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:16.716936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1311/2617] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:16 2022] DELETE /identity/v3/users/b7ae241ed2d7499a980b42eaf2ec085a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:17.027645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.029810 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:17.072633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2d33f-4bc8-4961-b656-5a3d9f393f6f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.176573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.177489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.177774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.178280 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] PATH_INFO: `/v3/projects/a3185302b2014991b051740b3a700122` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.180338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3185302b2014991b051740b3a700122)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.184340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.249164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:17.251173 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3185302b2014991b051740b3a700122', 'request_id': 'req-d843d702-0a20-4c89-a043-7f01bdc3f23b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:17.263140 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3185302b2014991b051740b3a700122', 'request_id': 'req-d843d702-0a20-4c89-a043-7f01bdc3f23b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:17.270787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3185302b2014991b051740b3a700122', 'request_id': 'req-d843d702-0a20-4c89-a043-7f01bdc3f23b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:17.285219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] The token cache is being invalidate because project a3185302b2014991b051740b3a700122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:17.285490 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:17.286209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d843d702-0a20-4c89-a043-7f01bdc3f23b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:17.287760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1307/2618] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:17 2022] DELETE /identity/v3/projects/a3185302b2014991b051740b3a700122 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:17.294331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf28db-ae99-4c3b-9909-5109cc417acc None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.294842 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf28db-ae99-4c3b-9909-5109cc417acc None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.294967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf28db-ae99-4c3b-9909-5109cc417acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.318971 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e8bf28db-ae99-4c3b-9909-5109cc417acc None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:17.320310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e8bf28db-ae99-4c3b-9909-5109cc417acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:17.522087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1312/2619] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:17.524400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16ece-29e1-4e26-bb91-28013429b1b4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.524790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16ece-29e1-4e26-bb91-28013429b1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.525137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa16ece-29e1-4e26-bb91-28013429b1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.551304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-7fa16ece-29e1-4e26-bb91-28013429b1b4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:17.552701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7fa16ece-29e1-4e26-bb91-28013429b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:17.561721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1308/2620] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:17.566485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf28db-ae99-4c3b-9909-5109cc417acc None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.577060 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf28db-ae99-4c3b-9909-5109cc417acc None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.583744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.584385 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.584690 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.584930 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.585677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:17.586032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.587664 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.604258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1313/2621] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:17.606338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16ece-29e1-4e26-bb91-28013429b1b4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.624539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa16ece-29e1-4e26-bb91-28013429b1b4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.630149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.630832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.631122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.631420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.632131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.634307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.665605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1309/2622] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:17 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:17.669952 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.681743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809da92-c680-4f62-98cb-063efd00f98e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.756034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.756708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.757187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.757435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.758237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.760210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.796333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1314/2623] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:17 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:17.801081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.815491 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79892736-2a53-486f-b16c-4bb31d04c944 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.821012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.821677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.821982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.822258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.823095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.824755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.841393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1310/2624] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:17.842933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.856675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302caed-489d-4a61-8f8b-954f99d8fe2a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.862461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8fdca-cef3-493a-8b50-fa0b41b149cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.863328 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8fdca-cef3-493a-8b50-fa0b41b149cb admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.863973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8fdca-cef3-493a-8b50-fa0b41b149cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.864479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8fdca-cef3-493a-8b50-fa0b41b149cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.865813 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8fdca-cef3-493a-8b50-fa0b41b149cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.867979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8fdca-cef3-493a-8b50-fa0b41b149cb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.880908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1315/2625] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:27:17.885426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:17.896977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68c97bc-b8fe-490c-98b4-c8d62de12919 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:17.902160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:17.903124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.903413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.903687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] PATH_INFO: `/v3/projects/4cdc1127c8f442b380d4ede5d99fa863/users/9680a091747e455bab4b33c371412220/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.922250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdc1127c8f442b380d4ede5d99fa863, user_id=9680a091747e455bab4b33c371412220, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:17.925907 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:17.941152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1311/2626] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:17 2022] PUT /identity/v3/projects/4cdc1127c8f442b380d4ede5d99fa863/users/9680a091747e455bab4b33c371412220/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:17.953535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da427-6d90-4e7e-8447-ef1d45bdd3fe None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:17.954182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da427-6d90-4e7e-8447-ef1d45bdd3fe None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:17.954636 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0da427-6d90-4e7e-8447-ef1d45bdd3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:17.994410 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3d0da427-6d90-4e7e-8447-ef1d45bdd3fe None None] MFA Rules not processed for user `9680a091747e455bab4b33c371412220`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:17.995976 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3d0da427-6d90-4e7e-8447-ef1d45bdd3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:18.044338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:18.073336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1316/2627] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:27:18.078147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:18.160532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e028b-60f2-4485-b11e-ab196c7eae1b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:18.167514 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:18.168354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.168725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.169024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.169829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:18.172001 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:18.207438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1312/2628] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:18 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:18.211454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da427-6d90-4e7e-8447-ef1d45bdd3fe None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:18.224479 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0da427-6d90-4e7e-8447-ef1d45bdd3fe None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:18.329780 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:18.330574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.330826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.331079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.331777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:18.333915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:18.365445 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1317/2629] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:18 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:18.369221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:18.381380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfda32-73de-4bca-b7cb-dd9dcf5c7b6d admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:18.386430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:18.387056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.387477 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.387750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.388535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:18.390513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:18.407273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1313/2630] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:18.408483 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:18.428108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d631ba-83dc-43a0-b48a-cec76296052a admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:18.433543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde8a99-be66-4b3b-8682-e0e2d38d3738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:18.434460 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8a99-be66-4b3b-8682-e0e2d38d3738 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.434596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8a99-be66-4b3b-8682-e0e2d38d3738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.434905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde8a99-be66-4b3b-8682-e0e2d38d3738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.435703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde8a99-be66-4b3b-8682-e0e2d38d3738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:18.437461 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde8a99-be66-4b3b-8682-e0e2d38d3738 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:18.449009 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1318/2631] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:27:18.453500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:18.464748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11a39a-0657-4dd4-ad6e-8ad4484fe0f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:18.474886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:18.476014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.476247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.476644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] PATH_INFO: `/v3/projects/5984004bd7fa4f6aa29aa4592e103a63/users/05d56a2829384992a7b2d8a598a914bd/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.501215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5984004bd7fa4f6aa29aa4592e103a63, user_id=05d56a2829384992a7b2d8a598a914bd, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:18.504399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:18.523489 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1314/2632] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:18 2022] PUT /identity/v3/projects/5984004bd7fa4f6aa29aa4592e103a63/users/05d56a2829384992a7b2d8a598a914bd/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:18.562418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547790-1cdd-42f4-9b4b-0d5c9c50546a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.562418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547790-1cdd-42f4-9b4b-0d5c9c50546a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.562418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b547790-1cdd-42f4-9b4b-0d5c9c50546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.639143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8b547790-1cdd-42f4-9b4b-0d5c9c50546a None None] MFA Rules not processed for user `05d56a2829384992a7b2d8a598a914bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:18.640395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8b547790-1cdd-42f4-9b4b-0d5c9c50546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:18.730386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1319/2633] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:18.736128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:18.772478 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:18.833949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4730-26d8-4c89-a7c9-0d5fccf2cc2f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:18.839133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:18.839881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.840274 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.840676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.841464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:18.843891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:18.880469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1315/2634] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:18 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:18.881755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b547790-1cdd-42f4-9b4b-0d5c9c50546a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:18.893439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b547790-1cdd-42f4-9b4b-0d5c9c50546a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:18.951907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:18.965007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:18.965891 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:18.966196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:18.966469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:18.967241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:18.969253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:19.009296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1320/2635] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:18 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:19.013808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:19.027256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039b36f-7a0b-4360-9463-9fd7b8d50147 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:19.033421 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:19.034508 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:19.034889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:19.035257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:19.036054 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:19.038304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:19.051944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1316/2636] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:19.056241 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:19.075703 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e488d-90ae-438c-b257-ce5c29a44068 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:19.082288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:19.083263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:19.083558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:19.084100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] PATH_INFO: `/v3/projects/936fc3684b404f9fa7f6e3562d3168fd/users/e45a9e4eb79942f19d78739814aaf979/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:19.109514 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936fc3684b404f9fa7f6e3562d3168fd, user_id=e45a9e4eb79942f19d78739814aaf979, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:19.113862 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:19.132064 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1321/2637] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:19 2022] PUT /identity/v3/projects/936fc3684b404f9fa7f6e3562d3168fd/users/e45a9e4eb79942f19d78739814aaf979/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:19.136550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:19.151053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b94508-9c11-4614-812a-9936f4c14180 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:19.222898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea869f01-6d97-4ca1-bf2d-d5d9cded809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:19.223803 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea869f01-6d97-4ca1-bf2d-d5d9cded809b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:19.224268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea869f01-6d97-4ca1-bf2d-d5d9cded809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:19.224613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea869f01-6d97-4ca1-bf2d-d5d9cded809b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:19.226137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea869f01-6d97-4ca1-bf2d-d5d9cded809b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:19.228858 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea869f01-6d97-4ca1-bf2d-d5d9cded809b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:19.240876 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1317/2638] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:19.245544 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:19.256757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55363a54-007d-44e5-88e8-c276e71ce817 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:19.262402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:19.263026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:19.263312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:19.263633 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] PATH_INFO: `/v3/projects/936fc3684b404f9fa7f6e3562d3168fd/users/e45a9e4eb79942f19d78739814aaf979/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:19.265950 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936fc3684b404f9fa7f6e3562d3168fd, user_id=e45a9e4eb79942f19d78739814aaf979, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:19.269696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:19.284641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1322/2639] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:19 2022] PUT /identity/v3/projects/936fc3684b404f9fa7f6e3562d3168fd/users/e45a9e4eb79942f19d78739814aaf979/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:19.296817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:19.297844 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:19.298580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:19.331618 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] MFA Rules not processed for user `e45a9e4eb79942f19d78739814aaf979`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:19.332838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:19.414053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1318/2640] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:19.420029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:19.422361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:19.547559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa28224-102a-45fd-b4be-291fcd5a5cf8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:19.552805 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c5dc2-6c66-4a5b-af5e-81395656a4a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:19.553576 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5dc2-6c66-4a5b-af5e-81395656a4a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:19.553958 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5dc2-6c66-4a5b-af5e-81395656a4a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:19.554434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c5dc2-6c66-4a5b-af5e-81395656a4a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:19.572061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5dc2-6c66-4a5b-af5e-81395656a4a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:19.573567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c5dc2-6c66-4a5b-af5e-81395656a4a1 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:19.596040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1323/2641] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:19.651390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:19.653649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:19.678143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ead76-b0ef-46fc-a0bb-630b8fc03ddd None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:19.683940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:19.684658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:19.685466 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:19.685777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:19.707159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:19.779266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:19.782375 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:19.794934 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1319/2642] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:20.153744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d83bb-08a9-4834-b205-49861f9e6055 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:20.154051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d83bb-08a9-4834-b205-49861f9e6055 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:20.154331 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d83bb-08a9-4834-b205-49861f9e6055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:20.185080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-c59d83bb-08a9-4834-b205-49861f9e6055 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:20.186706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c59d83bb-08a9-4834-b205-49861f9e6055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:20.255693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1324/2643] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 01:27:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:20.272982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:20.274372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:20.345271 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975352c-5b66-4b9b-9a7f-4f227fcaa8f3 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:20.350578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:20.351206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:20.351485 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:20.351760 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:20.360701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:20.362426 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:20.370599 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1320/2644] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:27:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:27:21.291585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f465-49a9-42bd-9d01-b011bfa64e17 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:21.292050 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f465-49a9-42bd-9d01-b011bfa64e17 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:21.292154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1f465-49a9-42bd-9d01-b011bfa64e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:21.313275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-26d1f465-49a9-42bd-9d01-b011bfa64e17 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:21.314850 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-26d1f465-49a9-42bd-9d01-b011bfa64e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:21.322876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1325/2645] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:21.335331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:21.346541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef776c47-949d-48a1-a7b3-dc0a3294995b service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:21.351591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffe1e1-81fc-447b-936a-573df0836b67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:21.352250 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe1e1-81fc-447b-936a-573df0836b67 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:21.352527 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe1e1-81fc-447b-936a-573df0836b67 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:21.352797 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffe1e1-81fc-447b-936a-573df0836b67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:21.362121 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe1e1-81fc-447b-936a-573df0836b67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:21.363303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffe1e1-81fc-447b-936a-573df0836b67 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:21.372595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1321/2646] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:27:22.830917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1f465-49a9-42bd-9d01-b011bfa64e17 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:22.887909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:22.920117 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1f465-49a9-42bd-9d01-b011bfa64e17 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:22.927067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:22.927768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:22.928083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:22.928369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] PATH_INFO: `/v3/users/9680a091747e455bab4b33c371412220` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:22.929698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9680a091747e455bab4b33c371412220)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:22.931923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:22.981230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9680a091747e455bab4b33c371412220'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:22.989545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9680a091747e455bab4b33c371412220'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.004305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9680a091747e455bab4b33c371412220'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.005037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9680a091747e455bab4b33c371412220'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.012734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9680a091747e455bab4b33c371412220'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.019712 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1326/2647] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:22 2022] DELETE /identity/v3/users/9680a091747e455bab4b33c371412220 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:23.025081 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.025614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.025740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.044632 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:23.045861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.107702 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1322/2648] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:23.117754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:23.119345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.193885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3463f7-2ea8-4394-a0e4-2cb590c8d254 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:23.198160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:23.198831 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.199126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.199377 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.209110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:23.210613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:23.220417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1327/2649] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:23.325752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:23.327352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.384706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:23.386706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.402143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=100 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:23.407059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16295f9-8187-4f02-80e0-75f827a9e208 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:23.412048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:23.412731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.415868 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.416184 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] PATH_INFO: `/v3/users/b060ac05eccb4ff9a96f516ab57a78d3` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.417603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b060ac05eccb4ff9a96f516ab57a78d3)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:23.419658 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:23.442711 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e89c3b-d00b-40f1-8a85-149b9d6327db None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:23.448210 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:23.448966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.449307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.449581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.452222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.473233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:23.474884 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:23.484867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b060ac05eccb4ff9a96f516ab57a78d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.485699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1323/2650] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:23.495061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b060ac05eccb4ff9a96f516ab57a78d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.505257 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:23.517412 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b060ac05eccb4ff9a96f516ab57a78d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.518585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b060ac05eccb4ff9a96f516ab57a78d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.531233 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b060ac05eccb4ff9a96f516ab57a78d3'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.537803 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1328/2651] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:23 2022] DELETE /identity/v3/users/b060ac05eccb4ff9a96f516ab57a78d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:23.547605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:23.549536 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.571061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5035-9343-4395-b9af-bbddb5ea4283 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:23.640724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:23.641411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.641715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.642009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] PATH_INFO: `/v3/projects/4cdc1127c8f442b380d4ede5d99fa863` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.643176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdc1127c8f442b380d4ede5d99fa863)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:23.645090 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:23.694831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdc1127c8f442b380d4ede5d99fa863', 'request_id': 'req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.703845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdc1127c8f442b380d4ede5d99fa863', 'request_id': 'req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.709852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdc1127c8f442b380d4ede5d99fa863', 'request_id': 'req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.721736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] The token cache is being invalidate because project 4cdc1127c8f442b380d4ede5d99fa863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:23.722047 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.722692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.724429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1324/2652] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:23 2022] DELETE /identity/v3/projects/4cdc1127c8f442b380d4ede5d99fa863 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:23.728040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:23.728772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:23.729971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.730728 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:23.747078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374e5b7-7cde-406f-8601-b99ffd7be2d1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:23.800894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:23.810972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:23.811720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.811992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.812260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] PATH_INFO: `/v3/users/05d56a2829384992a7b2d8a598a914bd` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.813083 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a7a3c-4698-4ebf-bef4-0376372ba5f2 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:23.813473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d56a2829384992a7b2d8a598a914bd)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:23.815587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:23.819313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:23.819966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.820252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.820522 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] PATH_INFO: `/v3/projects/43fe7165c5414a5f96ce14538cba87ad` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.821724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fe7165c5414a5f96ce14538cba87ad)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:23.823750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:23.863685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d56a2829384992a7b2d8a598a914bd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.872669 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d56a2829384992a7b2d8a598a914bd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.879302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fe7165c5414a5f96ce14538cba87ad', 'request_id': 'req-34dc9126-4dfe-4ca2-ad87-421871485972'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.887332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d56a2829384992a7b2d8a598a914bd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.888156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d56a2829384992a7b2d8a598a914bd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.888475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fe7165c5414a5f96ce14538cba87ad', 'request_id': 'req-34dc9126-4dfe-4ca2-ad87-421871485972'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.894303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fe7165c5414a5f96ce14538cba87ad', 'request_id': 'req-34dc9126-4dfe-4ca2-ad87-421871485972'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.895433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-96da6d66-ad4f-4a24-aa3f-6f5904145066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d56a2829384992a7b2d8a598a914bd'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.904740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1329/2653] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:23 2022] DELETE /identity/v3/users/05d56a2829384992a7b2d8a598a914bd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:23.905565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] The token cache is being invalidate because project 43fe7165c5414a5f96ce14538cba87ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:23.905850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.906570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-34dc9126-4dfe-4ca2-ad87-421871485972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:23.908251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1325/2654] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:23 2022] DELETE /identity/v3/projects/43fe7165c5414a5f96ce14538cba87ad => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:23.913246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9089-d99b-45a6-b48c-ff0087158ab5 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:23.913528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9089-d99b-45a6-b48c-ff0087158ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:23.913801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a9089-d99b-45a6-b48c-ff0087158ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:23.935059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-003a9089-d99b-45a6-b48c-ff0087158ab5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:23.936469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-003a9089-d99b-45a6-b48c-ff0087158ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.011621 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:24.024454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1330/2655] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:27:24.033166 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcdd3-c8d8-469a-adf6-16b3d3d719e8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.034245 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcdd3-c8d8-469a-adf6-16b3d3d719e8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.034521 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bcdd3-c8d8-469a-adf6-16b3d3d719e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.054291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e67bcdd3-c8d8-469a-adf6-16b3d3d719e8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:24.055406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e67bcdd3-c8d8-469a-adf6-16b3d3d719e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.064621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1326/2656] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:24.069383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9089-d99b-45a6-b48c-ff0087158ab5 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.080063 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a9089-d99b-45a6-b48c-ff0087158ab5 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.085023 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.085724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.086098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.086402 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.087121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:24.087653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.089201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.106027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1331/2657] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:24.108234 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bcdd3-c8d8-469a-adf6-16b3d3d719e8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.117885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bcdd3-c8d8-469a-adf6-16b3d3d719e8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.122698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.123291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.123589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.123862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.124672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.126614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.155814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1327/2658] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:24 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:24.159973 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.171074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4c98-dac6-41ac-8542-1c9891b54147 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.202105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.204160 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.247054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.247706 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.247977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.248249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.248978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.250965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.276381 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1332/2659] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:24 2022] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:24.276615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2972b8-2da7-4a7e-a13d-2b7e556b37ea admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.277555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.279602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.280306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.280584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.280881 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] PATH_INFO: `/v3/projects/5984004bd7fa4f6aa29aa4592e103a63` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.282074 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5984004bd7fa4f6aa29aa4592e103a63)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.284211 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.287472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9078e-2ad3-46d4-82d3-02b22e18850e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.296693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.296693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.296693 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.297097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.297642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.299296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.310662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1333/2660] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:24.314873 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.324829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e1d6b-6f1a-4124-b1cc-c36c7ca08d29 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.332996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5984004bd7fa4f6aa29aa4592e103a63', 'request_id': 'req-e1f38cbb-b6d3-436e-bd15-21d59fd08371'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.341748 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5984004bd7fa4f6aa29aa4592e103a63', 'request_id': 'req-e1f38cbb-b6d3-436e-bd15-21d59fd08371'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.344171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:24.350969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5984004bd7fa4f6aa29aa4592e103a63', 'request_id': 'req-e1f38cbb-b6d3-436e-bd15-21d59fd08371'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.368376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] The token cache is being invalidate because project 5984004bd7fa4f6aa29aa4592e103a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:24.368666 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.369378 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.370964 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1328/2661] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:24 2022] DELETE /identity/v3/projects/5984004bd7fa4f6aa29aa4592e103a63 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:24.374851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.376228 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.384778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.385594 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.385878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.386612 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.386970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.388583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.398865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1334/2662] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:27:24.402992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.404737 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.417355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf1a92-3472-4dc7-8655-c1beba4a068b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.423034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38731f9a-d628-4863-86b5-dac0d8f05ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.423758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38731f9a-d628-4863-86b5-dac0d8f05ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.424021 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38731f9a-d628-4863-86b5-dac0d8f05ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.424293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38731f9a-d628-4863-86b5-dac0d8f05ea9 admin admin] PATH_INFO: `/v3/projects/6972f289fb23447f955da4e2ce644a38/users/af15a4b01b084a0d8cc497fd2aa6ce66/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.439821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38731f9a-d628-4863-86b5-dac0d8f05ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6972f289fb23447f955da4e2ce644a38, user_id=af15a4b01b084a0d8cc497fd2aa6ce66, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.442571 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38731f9a-d628-4863-86b5-dac0d8f05ea9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.448620 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f38cbb-b6d3-436e-bd15-21d59fd08371 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.454570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.455224 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.455498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.455765 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] PATH_INFO: `/v3/users/e45a9e4eb79942f19d78739814aaf979` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.456967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e45a9e4eb79942f19d78739814aaf979)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.457815 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1335/2663] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:24 2022] PUT /identity/v3/projects/6972f289fb23447f955da4e2ce644a38/users/af15a4b01b084a0d8cc497fd2aa6ce66/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:24.458949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.468528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.468861 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.469164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.502003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] MFA Rules not processed for user `af15a4b01b084a0d8cc497fd2aa6ce66`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:24.502003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.516543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e45a9e4eb79942f19d78739814aaf979'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.523584 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e45a9e4eb79942f19d78739814aaf979'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.524264 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e45a9e4eb79942f19d78739814aaf979'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.529555 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:24.536288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e45a9e4eb79942f19d78739814aaf979'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.543845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e45a9e4eb79942f19d78739814aaf979'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:24.549986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1329/2664] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:24 2022] DELETE /identity/v3/users/e45a9e4eb79942f19d78739814aaf979 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:24.574496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1336/2665] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:24.591990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.593461 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.670167 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d2486-50d3-44ad-b6bf-f4f1d550e10a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.674079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a58df4-9f44-4fe0-8034-f14d24a8d840 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.674742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58df4-9f44-4fe0-8034-f14d24a8d840 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.675024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58df4-9f44-4fe0-8034-f14d24a8d840 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.675296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58df4-9f44-4fe0-8034-f14d24a8d840 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.692776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:24.750733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a58df4-9f44-4fe0-8034-f14d24a8d840 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.752297 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a58df4-9f44-4fe0-8034-f14d24a8d840 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:24.761313 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1330/2666] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:24.843574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:24.845098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:24.918725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb00ff-66d8-4fb9-8242-37efb879a7ea None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:24.991136 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:24.991806 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:24.992083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:24.992357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] PATH_INFO: `/v3/projects/936fc3684b404f9fa7f6e3562d3168fd` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:24.993545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] RBAC: Authorizing `identity:delete_project(project_id=936fc3684b404f9fa7f6e3562d3168fd)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:24.995561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.059040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936fc3684b404f9fa7f6e3562d3168fd', 'request_id': 'req-f8d1954b-f623-415d-8c63-491c7b10550b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:25.069260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936fc3684b404f9fa7f6e3562d3168fd', 'request_id': 'req-f8d1954b-f623-415d-8c63-491c7b10550b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:25.075642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936fc3684b404f9fa7f6e3562d3168fd', 'request_id': 'req-f8d1954b-f623-415d-8c63-491c7b10550b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:25.087283 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] The token cache is being invalidate because project 936fc3684b404f9fa7f6e3562d3168fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:25.087583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:25.088280 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f8d1954b-f623-415d-8c63-491c7b10550b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:25.089913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1337/2667] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:24 2022] DELETE /identity/v3/projects/936fc3684b404f9fa7f6e3562d3168fd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:25.096117 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c827-837b-4388-afb8-9e95da9b76a8 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.096625 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c827-837b-4388-afb8-9e95da9b76a8 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.096747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94c827-837b-4388-afb8-9e95da9b76a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.117563 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-cb94c827-837b-4388-afb8-9e95da9b76a8 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:25.118898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-cb94c827-837b-4388-afb8-9e95da9b76a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:25.182976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1331/2668] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:25.197386 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289caa4-8066-455e-8c06-fa984efe4999 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.197908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289caa4-8066-455e-8c06-fa984efe4999 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.198292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289caa4-8066-455e-8c06-fa984efe4999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.208248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:25.222230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d289caa4-8066-455e-8c06-fa984efe4999 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:25.224792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d289caa4-8066-455e-8c06-fa984efe4999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:25.238126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1338/2669] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:25.240176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c827-837b-4388-afb8-9e95da9b76a8 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.259665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94c827-837b-4388-afb8-9e95da9b76a8 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.264668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.265364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.265611 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.265912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.266936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:25.267062 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.268651 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.280904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1332/2670] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:25.285602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289caa4-8066-455e-8c06-fa984efe4999 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.295155 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289caa4-8066-455e-8c06-fa984efe4999 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.300232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.300816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.301212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.301520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.302334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.304271 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.331579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1339/2671] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:25 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:25.335969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.347204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb22e79-3c56-473d-ae3a-179ff7ad0c09 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.404993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.405614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.405889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.406192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.406855 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.408774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.437184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1333/2672] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:25 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:25.440651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.451436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31633e45-d9af-4f87-9eba-cb8fff5b0d60 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.456596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.457227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.457499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.457767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.458501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.460124 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.469960 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1340/2673] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:25.474012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.484759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90918bef-5344-4b1c-9f24-79de8165edc7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.490075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fe49f-5639-4e7c-97af-597468b7d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.490595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe49f-5639-4e7c-97af-597468b7d570 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.490856 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe49f-5639-4e7c-97af-597468b7d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.491147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fe49f-5639-4e7c-97af-597468b7d570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.491852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fe49f-5639-4e7c-97af-597468b7d570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.493456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853fe49f-5639-4e7c-97af-597468b7d570 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.508926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1334/2674] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:25.513151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.523683 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eddfec-639a-4699-9daf-e667272428c2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.528888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.529547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.529949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.530235 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] PATH_INFO: `/v3/projects/891c07477607430fa1f72bfe0ca25ff2/users/6294da55a5c140ac89c4aeca25598e82/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.545997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891c07477607430fa1f72bfe0ca25ff2, user_id=6294da55a5c140ac89c4aeca25598e82, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.548635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.564195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1341/2675] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:25 2022] PUT /identity/v3/projects/891c07477607430fa1f72bfe0ca25ff2/users/6294da55a5c140ac89c4aeca25598e82/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:25.636206 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d2ad-8f46-4c0e-81e8-2a12d5cb609d None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.636500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d2ad-8f46-4c0e-81e8-2a12d5cb609d None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.636756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288d2ad-8f46-4c0e-81e8-2a12d5cb609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.665133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8288d2ad-8f46-4c0e-81e8-2a12d5cb609d None None] MFA Rules not processed for user `6294da55a5c140ac89c4aeca25598e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:25.666450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8288d2ad-8f46-4c0e-81e8-2a12d5cb609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:25.683078 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:25.743502 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1335/2676] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:27:25.748116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.813234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84f44d-896f-4d46-9e0c-3ab1c595edc2 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.818231 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.818853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.819129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.819399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.820061 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.821983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.850125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1342/2677] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:25 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:25.854714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d2ad-8f46-4c0e-81e8-2a12d5cb609d None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.865646 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288d2ad-8f46-4c0e-81e8-2a12d5cb609d None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.926305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.927095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.927429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.927706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.928581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.931222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.956137 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1336/2678] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:25 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:25.960253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:25.971078 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce55c8c-c8a9-4b30-931b-5bc92efde5f7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:25.976240 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:25.976857 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:25.977134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:25.977393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:25.978162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:25.980178 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:25.995243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1343/2679] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:25.996442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:26.006633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543e402-4a47-4e15-b27f-555d93f6bf49 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:26.011447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:26.012100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:26.012407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:26.012682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] PATH_INFO: `/v3/projects/985232e1636441aea13750857ab4c000/users/46057cbd27ed4939bd9fd13088c27097/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:26.027740 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] RBAC: Authorizing `identity:create_grant(project_id=985232e1636441aea13750857ab4c000, user_id=46057cbd27ed4939bd9fd13088c27097, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:26.030602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:26.045656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1337/2680] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:25 2022] PUT /identity/v3/projects/985232e1636441aea13750857ab4c000/users/46057cbd27ed4939bd9fd13088c27097/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:26.049777 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:26.060539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92a6a4-5bbe-4d22-b6d8-a796d166a0eb admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:26.124927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72427b8-6e05-4134-ac94-a8590fd2ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:26.125467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72427b8-6e05-4134-ac94-a8590fd2ab4d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:26.125746 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72427b8-6e05-4134-ac94-a8590fd2ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:26.126019 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72427b8-6e05-4134-ac94-a8590fd2ab4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:26.126721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72427b8-6e05-4134-ac94-a8590fd2ab4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:26.128409 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72427b8-6e05-4134-ac94-a8590fd2ab4d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:26.138934 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1344/2681] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:26.143352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:26.153605 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8d06b-7ea1-4f11-be3b-7fd713be132c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:26.158496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:26.159149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:26.159427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:26.159698 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] PATH_INFO: `/v3/projects/985232e1636441aea13750857ab4c000/users/46057cbd27ed4939bd9fd13088c27097/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:26.161661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985232e1636441aea13750857ab4c000, user_id=46057cbd27ed4939bd9fd13088c27097, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:26.164323 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:26.174443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1338/2682] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:26 2022] PUT /identity/v3/projects/985232e1636441aea13750857ab4c000/users/46057cbd27ed4939bd9fd13088c27097/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:26.184800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6fa6-72c5-426f-a449-06fb4c9c5ce1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:26.185083 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6fa6-72c5-426f-a449-06fb4c9c5ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:26.185360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a6fa6-72c5-426f-a449-06fb4c9c5ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:26.205535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:26.215552 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-5b6a6fa6-72c5-426f-a449-06fb4c9c5ce1 None None] MFA Rules not processed for user `46057cbd27ed4939bd9fd13088c27097`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:26.217539 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5b6a6fa6-72c5-426f-a449-06fb4c9c5ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:26.295321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1345/2683] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:27:26.306919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:26.308786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:26.375343 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977ace3-3fd3-4c67-a33d-ad383eea3283 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:26.379643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:26.380269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:26.380548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:26.380820 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:26.390337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:26.391787 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:26.401335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1339/2684] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:26.489250 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6fa6-72c5-426f-a449-06fb4c9c5ce1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:26.502336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a6fa6-72c5-426f-a449-06fb4c9c5ce1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:26.507087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa20057a-bd9b-4426-894f-dd28e2da58f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:26.508128 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20057a-bd9b-4426-894f-dd28e2da58f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:26.508128 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20057a-bd9b-4426-894f-dd28e2da58f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:26.508297 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa20057a-bd9b-4426-894f-dd28e2da58f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:26.572049 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20057a-bd9b-4426-894f-dd28e2da58f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:26.573564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa20057a-bd9b-4426-894f-dd28e2da58f0 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:26.584550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1346/2685] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:31.444990 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:31.455132 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:31.509871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061edf74-87b5-484d-a997-f5b9204b0586 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:31.515130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:31.515777 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:31.516040 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:31.516319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] PATH_INFO: `/v3/users/6294da55a5c140ac89c4aeca25598e82` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:31.517684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6294da55a5c140ac89c4aeca25598e82)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:31.519695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:31.571455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6294da55a5c140ac89c4aeca25598e82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:31.578763 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6294da55a5c140ac89c4aeca25598e82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:31.579488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6294da55a5c140ac89c4aeca25598e82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:31.592609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6294da55a5c140ac89c4aeca25598e82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:31.601404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6294da55a5c140ac89c4aeca25598e82'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:31.608928 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1340/2686] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:31 2022] DELETE /identity/v3/users/6294da55a5c140ac89c4aeca25598e82 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:31.613527 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:31.614421 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:31.614942 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:31.635653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:31.636877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:31.709469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1347/2687] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:31.721474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:31.723017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:31.782002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cdd02-0307-4a7c-9426-432fd4a1506f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:31.785919 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:31.786615 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:31.786894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:31.787172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:31.796263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:31.797793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:31.807163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1341/2688] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:27:32.111367 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:32.112871 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:32.125408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a338fc2-c742-4de0-a93f-98ab0d99623b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:32.130272 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:32.131002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:32.131348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:32.131688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] PATH_INFO: `/v3/projects/891c07477607430fa1f72bfe0ca25ff2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:32.132950 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891c07477607430fa1f72bfe0ca25ff2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:32.135394 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:32.169289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:32.184312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891c07477607430fa1f72bfe0ca25ff2', 'request_id': 'req-5d9d93b6-6342-4798-9562-a000d1e2d6c5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.194547 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891c07477607430fa1f72bfe0ca25ff2', 'request_id': 'req-5d9d93b6-6342-4798-9562-a000d1e2d6c5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.201278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891c07477607430fa1f72bfe0ca25ff2', 'request_id': 'req-5d9d93b6-6342-4798-9562-a000d1e2d6c5'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.213865 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] The token cache is being invalidate because project 891c07477607430fa1f72bfe0ca25ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:32.214199 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.214943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.216588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1348/2689] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:32 2022] DELETE /identity/v3/projects/891c07477607430fa1f72bfe0ca25ff2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:32.221370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:32.231838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22ea9b-805b-4426-8541-623b4b95e268 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:32.270510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:32.311973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:32.312568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:32.313049 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:32.313558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] PATH_INFO: `/v3/users/46057cbd27ed4939bd9fd13088c27097` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:32.315510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46057cbd27ed4939bd9fd13088c27097)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:32.318015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:32.365158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46057cbd27ed4939bd9fd13088c27097'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.372052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46057cbd27ed4939bd9fd13088c27097'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.372674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46057cbd27ed4939bd9fd13088c27097'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.385092 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46057cbd27ed4939bd9fd13088c27097'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.395020 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-9d192ddc-b60d-41a3-b1fc-c70cbcc93942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46057cbd27ed4939bd9fd13088c27097'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.401438 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1342/2690] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:32 2022] DELETE /identity/v3/users/46057cbd27ed4939bd9fd13088c27097 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:32.683482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:32.685322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:32.705308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d93b6-6342-4798-9562-a000d1e2d6c5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:32.764449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:32.765102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:32.765368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:32.765657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] PATH_INFO: `/v3/projects/985232e1636441aea13750857ab4c000` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:32.766938 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=985232e1636441aea13750857ab4c000)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:32.768851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:32.822523 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985232e1636441aea13750857ab4c000', 'request_id': 'req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.831657 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985232e1636441aea13750857ab4c000', 'request_id': 'req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.837503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985232e1636441aea13750857ab4c000', 'request_id': 'req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.848717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] The token cache is being invalidate because project 985232e1636441aea13750857ab4c000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:32.848998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.849616 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-fcf34cd4-bac8-4e2e-a4b4-06857e8a86b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:32.851209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1349/2691] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:32 2022] DELETE /identity/v3/projects/985232e1636441aea13750857ab4c000 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:32.856710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee759d-be31-4067-8340-a6139f430e1c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:32.857187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee759d-be31-4067-8340-a6139f430e1c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:32.857324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee759d-be31-4067-8340-a6139f430e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:32.878878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-8aee759d-be31-4067-8340-a6139f430e1c None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:32.880071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-8aee759d-be31-4067-8340-a6139f430e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:32.947664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1343/2692] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:27:32.955660 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252a8e-bc41-4091-ba55-8aabb215e1bb None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:32.955948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252a8e-bc41-4091-ba55-8aabb215e1bb None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:32.956224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252a8e-bc41-4091-ba55-8aabb215e1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:32.977411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-93252a8e-bc41-4091-ba55-8aabb215e1bb None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:32.979033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-93252a8e-bc41-4091-ba55-8aabb215e1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:32.987686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1350/2693] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:32.992262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee759d-be31-4067-8340-a6139f430e1c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:33.002687 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee759d-be31-4067-8340-a6139f430e1c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:33.007678 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:33.008300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.008575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.008840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.009531 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:33.009833 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:33.011523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:33.023358 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1344/2694] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:33.028246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252a8e-bc41-4091-ba55-8aabb215e1bb None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:33.042999 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252a8e-bc41-4091-ba55-8aabb215e1bb None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:33.051191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:33.051808 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.052091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.052347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.053005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:33.054962 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:33.088123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1351/2695] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:33 2022] POST /identity/v3/projects => generated 391 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:33.089305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:33.099814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a765-db05-4c21-b402-0bba1c5ebde7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:33.132768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:33.168312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:33.168977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.169395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.169681 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.170440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:33.172456 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:33.193621 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1345/2696] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:33 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:33.199769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:33.210285 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5da4a-9dda-4f4b-b5bb-78f63d7ea227 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:33.214977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:33.215595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.215878 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.216153 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.216857 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:33.218511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:33.229106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1352/2697] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:33.233334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:33.243885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059433-ea8d-4623-a868-2e3a841fbc17 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:33.248616 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454190a-9ab5-4357-9968-f4b30df46680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:33.249240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454190a-9ab5-4357-9968-f4b30df46680 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.249519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454190a-9ab5-4357-9968-f4b30df46680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.249786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454190a-9ab5-4357-9968-f4b30df46680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.250583 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454190a-9ab5-4357-9968-f4b30df46680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:33.252283 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454190a-9ab5-4357-9968-f4b30df46680 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:33.263161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1346/2698] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:33.267622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:33.278441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d239e-faf7-49ec-bf85-a9a7cc20857b admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:33.284369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:33.285056 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.285334 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.285607 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] PATH_INFO: `/v3/projects/c63f1255852048f2932c2d1b287793f0/users/7947cf7175c74c48b837b39ecfc26ffd/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.288170 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:33.303661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63f1255852048f2932c2d1b287793f0, user_id=7947cf7175c74c48b837b39ecfc26ffd, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:33.306933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:33.326176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1353/2699] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:33 2022] PUT /identity/v3/projects/c63f1255852048f2932c2d1b287793f0/users/7947cf7175c74c48b837b39ecfc26ffd/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:33.337123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.337416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.337695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.368354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] MFA Rules not processed for user `7947cf7175c74c48b837b39ecfc26ffd`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:33.369779 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:33.450303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1347/2700] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:33.462059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:33.464005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:33.530428 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c4ba4-cef0-4a37-a816-6e17f70c3419 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:33.534294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0578a62-c366-4ca7-8900-c26424a9ca95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:33.534918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578a62-c366-4ca7-8900-c26424a9ca95 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:33.535190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578a62-c366-4ca7-8900-c26424a9ca95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:33.535457 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0578a62-c366-4ca7-8900-c26424a9ca95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:33.544432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0578a62-c366-4ca7-8900-c26424a9ca95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:33.545884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0578a62-c366-4ca7-8900-c26424a9ca95 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:33.554887 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1354/2701] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:39.118664 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:39.120251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:39.195959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d06a37-24eb-4a72-a10d-e75a02f0b87c None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:39.200977 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:39.201639 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:39.202034 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:39.202221 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] PATH_INFO: `/v3/users/5974a9b4b7164d1f8561f9bb6be0356b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:39.203429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5974a9b4b7164d1f8561f9bb6be0356b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:39.205355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:39.259295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5974a9b4b7164d1f8561f9bb6be0356b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.260868 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:39.269026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5974a9b4b7164d1f8561f9bb6be0356b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.270232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5974a9b4b7164d1f8561f9bb6be0356b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.287669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5974a9b4b7164d1f8561f9bb6be0356b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.296244 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5974a9b4b7164d1f8561f9bb6be0356b'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.302567 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1348/2702] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:39 2022] DELETE /identity/v3/users/5974a9b4b7164d1f8561f9bb6be0356b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:39.307148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:39.307629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:39.307725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:39.327227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:39.328427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:39.393349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1355/2703] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:39.406580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:39.408829 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:39.478417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b8506-064b-4091-9607-49d2bc898456 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:39.482334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753ada5-e287-4a28-9a59-25dbf40f8029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:39.482959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ada5-e287-4a28-9a59-25dbf40f8029 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:39.483237 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ada5-e287-4a28-9a59-25dbf40f8029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:39.483507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753ada5-e287-4a28-9a59-25dbf40f8029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:39.492950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753ada5-e287-4a28-9a59-25dbf40f8029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:39.494497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753ada5-e287-4a28-9a59-25dbf40f8029 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:39.504887 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1349/2704] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:39.782731 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:39.784190 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:39.797027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f57ce-8954-4ded-9268-6040cda6e65b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:39.804662 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:39.805333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:39.805611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:39.805966 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] PATH_INFO: `/v3/projects/9683f172af424c649ab3c404d864e938` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:39.807212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9683f172af424c649ab3c404d864e938)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:39.809160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:39.860057 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9683f172af424c649ab3c404d864e938', 'request_id': 'req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.870936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9683f172af424c649ab3c404d864e938', 'request_id': 'req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.880459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9683f172af424c649ab3c404d864e938', 'request_id': 'req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.892041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] The token cache is being invalidate because project 9683f172af424c649ab3c404d864e938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:39.892357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.893017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a6bf2ff2-defc-4471-9a9f-4b44d7c20228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:39.894580 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1356/2705] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:39 2022] DELETE /identity/v3/projects/9683f172af424c649ab3c404d864e938 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:39.899752 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33505-73d5-4801-9a57-fc5120369d02 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:39.900032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33505-73d5-4801-9a57-fc5120369d02 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:39.900306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e33505-73d5-4801-9a57-fc5120369d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:39.919938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f5e33505-73d5-4801-9a57-fc5120369d02 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:39.921201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f5e33505-73d5-4801-9a57-fc5120369d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:39.981334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1350/2706] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:39.989270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff505b-3c68-4c08-8501-8bbed3661eb0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:39.989558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff505b-3c68-4c08-8501-8bbed3661eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:39.989834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff505b-3c68-4c08-8501-8bbed3661eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.009853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-07ff505b-3c68-4c08-8501-8bbed3661eb0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:40.011132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-07ff505b-3c68-4c08-8501-8bbed3661eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:40.020195 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1357/2707] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:40.025912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e33505-73d5-4801-9a57-fc5120369d02 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:40.038592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e33505-73d5-4801-9a57-fc5120369d02 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:40.044010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:40.044650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.044926 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.045214 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.045890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:40.046239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:40.048233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:40.062655 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1351/2708] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:40.067135 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff505b-3c68-4c08-8501-8bbed3661eb0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:40.071851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:40.078450 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff505b-3c68-4c08-8501-8bbed3661eb0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:40.084899 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:40.085595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.086003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.086343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.087289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:40.091863 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:40.118825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1358/2709] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:40 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:40.123053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:40.133365 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196419a1-b19e-4b48-889a-72da9f422993 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:40.183417 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:40.191146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:40.191776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.192187 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.192610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.193717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:40.195976 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:40.221097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1352/2710] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:40 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:40.225622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:40.236910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ef1f3-2a42-4a59-a8c8-8b30222bded3 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:40.242201 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:40.242828 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.243108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.243375 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.244095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:40.245749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:40.256755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1359/2711] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:27:40.261197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:40.271288 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d9106-5c49-45d0-a03f-df3fcfa1ea51 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:40.276178 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448aa95-0948-48f0-bac8-a06d000b516b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:40.276722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448aa95-0948-48f0-bac8-a06d000b516b admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.276997 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448aa95-0948-48f0-bac8-a06d000b516b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.277270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448aa95-0948-48f0-bac8-a06d000b516b admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.277992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448aa95-0948-48f0-bac8-a06d000b516b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:40.279594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448aa95-0948-48f0-bac8-a06d000b516b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:40.291354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1353/2712] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:40.295534 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:40.306016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f07fc0-5aae-4b45-8629-4c4c058ebfa6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:40.311652 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:40.312332 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.312610 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.312881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] PATH_INFO: `/v3/projects/95e5e3b9720841c3a04ad0a63721d7f1/users/a4fb51a5013d4243a240874a7b162ce2/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.329251 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e5e3b9720841c3a04ad0a63721d7f1, user_id=a4fb51a5013d4243a240874a7b162ce2, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:40.333180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:40.347132 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1360/2713] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:40 2022] PUT /identity/v3/projects/95e5e3b9720841c3a04ad0a63721d7f1/users/a4fb51a5013d4243a240874a7b162ce2/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:40.364251 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.364682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.367989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.398019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] MFA Rules not processed for user `a4fb51a5013d4243a240874a7b162ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:40.399273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:40.467788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1354/2714] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:40.480208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:40.482123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:40.540518 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885456c5-d224-4a57-aae4-64169492dc23 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:40.544416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdef53f-ce24-4c9e-9a7b-9e6da27e8955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:40.545093 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef53f-ce24-4c9e-9a7b-9e6da27e8955 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:40.545348 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef53f-ce24-4c9e-9a7b-9e6da27e8955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:40.545615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdef53f-ce24-4c9e-9a7b-9e6da27e8955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:40.554417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdef53f-ce24-4c9e-9a7b-9e6da27e8955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:40.555845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdef53f-ce24-4c9e-9a7b-9e6da27e8955 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:40.564655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1361/2715] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:43.654405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:43.656036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:43.722728 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6630a-4e5b-4467-a947-0cf39199be1a None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:43.729103 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:43.729759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:43.730060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:43.730328 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] PATH_INFO: `/v3/users/7947cf7175c74c48b837b39ecfc26ffd` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:43.731650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7947cf7175c74c48b837b39ecfc26ffd)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:43.734146 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:43.785041 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7947cf7175c74c48b837b39ecfc26ffd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:43.792301 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7947cf7175c74c48b837b39ecfc26ffd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:43.792966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7947cf7175c74c48b837b39ecfc26ffd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:43.799916 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:43.805967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7947cf7175c74c48b837b39ecfc26ffd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:43.814033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7947cf7175c74c48b837b39ecfc26ffd'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:43.820098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1355/2716] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:43 2022] DELETE /identity/v3/users/7947cf7175c74c48b837b39ecfc26ffd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:43.825671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:43.826253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:43.826355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:43.847346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:43.848671 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:43.911225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1362/2717] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:43.921116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:43.922644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:43.981812 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b3b8d-f32a-4985-ab9b-8f527d99adf4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:43.985642 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62277ffa-2ecf-4092-a880-5c353a019f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:43.986300 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277ffa-2ecf-4092-a880-5c353a019f91 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:43.986577 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277ffa-2ecf-4092-a880-5c353a019f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:43.986851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62277ffa-2ecf-4092-a880-5c353a019f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:43.996392 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62277ffa-2ecf-4092-a880-5c353a019f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:43.997861 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62277ffa-2ecf-4092-a880-5c353a019f91 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.007188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1356/2718] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:44.280526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.282243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:44.301109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6637c-18ea-430c-8930-aa323718bed4 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:44.306567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:44.307364 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.307722 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.308212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] PATH_INFO: `/v3/projects/c63f1255852048f2932c2d1b287793f0` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.309275 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63f1255852048f2932c2d1b287793f0)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:44.311261 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.358708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:44.362915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63f1255852048f2932c2d1b287793f0', 'request_id': 'req-54886e6b-0d58-4155-a994-42758b29198f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:44.372845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63f1255852048f2932c2d1b287793f0', 'request_id': 'req-54886e6b-0d58-4155-a994-42758b29198f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:44.382198 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63f1255852048f2932c2d1b287793f0', 'request_id': 'req-54886e6b-0d58-4155-a994-42758b29198f'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:44.394620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] The token cache is being invalidate because project c63f1255852048f2932c2d1b287793f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:44.394909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:44.395564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-54886e6b-0d58-4155-a994-42758b29198f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:44.397121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1363/2719] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:44 2022] DELETE /identity/v3/projects/c63f1255852048f2932c2d1b287793f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:44.402978 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b4a72-add7-4687-9380-70db3e05a2fa None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.403334 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b4a72-add7-4687-9380-70db3e05a2fa None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.403612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b4a72-add7-4687-9380-70db3e05a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.423231 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-549b4a72-add7-4687-9380-70db3e05a2fa None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:44.424429 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-549b4a72-add7-4687-9380-70db3e05a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:44.487573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1357/2720] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:44.496869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7d9ef-cd06-4c82-950b-6085494cb9c9 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.497339 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7d9ef-cd06-4c82-950b-6085494cb9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.497677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7d9ef-cd06-4c82-950b-6085494cb9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.518227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fce7d9ef-cd06-4c82-950b-6085494cb9c9 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:44.519432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fce7d9ef-cd06-4c82-950b-6085494cb9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:44.528176 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1364/2721] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:44.532750 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b4a72-add7-4687-9380-70db3e05a2fa None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.542636 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b4a72-add7-4687-9380-70db3e05a2fa None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:44.547504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:44.548112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.548393 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.548656 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.549347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:27:44.549649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:44.551285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.563087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1358/2722] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:27:44.567473 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7d9ef-cd06-4c82-950b-6085494cb9c9 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.577323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7d9ef-cd06-4c82-950b-6085494cb9c9 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:44.583311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:44.583928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.584185 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.584452 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.585116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:44.587072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.617882 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1365/2723] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:44 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:44.622626 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.633037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab5660-017a-4bfb-a9fb-69c9325f136c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:44.696541 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:44.697267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.697595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.697712 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.701463 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:44.703464 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.726352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1359/2724] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:44 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:44.731208 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.742002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5535d-b840-4a71-aec5-f96daea3010d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:44.747400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:44.748040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.748320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.748590 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.749292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:44.750933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.764509 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1366/2725] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:27:44.765809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.771355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:44.777962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef9341-bb80-4b83-9fb1-bb0c1b1413f1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:44.784455 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a5f53-8c66-410d-8ccb-bdff03a86cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:44.785112 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5f53-8c66-410d-8ccb-bdff03a86cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.785411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5f53-8c66-410d-8ccb-bdff03a86cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.785738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5f53-8c66-410d-8ccb-bdff03a86cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.786517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a5f53-8c66-410d-8ccb-bdff03a86cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:44.788222 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a5f53-8c66-410d-8ccb-bdff03a86cfa admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.802383 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1360/2726] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:44.809569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.820742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364aaad-f6fa-43bd-b468-a413c86e57b0 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:44.826521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:44.827193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.827469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.827762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] PATH_INFO: `/v3/projects/fb3ff3c3abe449d881f689a16873acd1/users/3bf630b761f947e8a4f3b70a21e89af1/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.843838 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3ff3c3abe449d881f689a16873acd1, user_id=3bf630b761f947e8a4f3b70a21e89af1, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:44.846600 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:44.861044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1367/2727] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:44 2022] PUT /identity/v3/projects/fb3ff3c3abe449d881f689a16873acd1/users/3bf630b761f947e8a4f3b70a21e89af1/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:44.866277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab491-2bb1-4c65-8d73-f0fb2ccadc64 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:44.866633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab491-2bb1-4c65-8d73-f0fb2ccadc64 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:44.866912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dab491-2bb1-4c65-8d73-f0fb2ccadc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:44.886360 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-93dab491-2bb1-4c65-8d73-f0fb2ccadc64 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:44.887640 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-93dab491-2bb1-4c65-8d73-f0fb2ccadc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:44.946588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1361/2728] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:44.956679 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:44.958717 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:45.017417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad23eb98-9d67-45eb-8478-f91372b342a5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:45.021290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:45.021909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:45.022209 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:45.022476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:45.031611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:45.033038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:45.042387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1368/2729] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:49.490498 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22ffb6-0bf8-4a73-8f27-41a7cab88612 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:49.491031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22ffb6-0bf8-4a73-8f27-41a7cab88612 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:49.491273 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22ffb6-0bf8-4a73-8f27-41a7cab88612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:49.531756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2e22ffb6-0bf8-4a73-8f27-41a7cab88612 None None] MFA Rules not processed for user `3bf630b761f947e8a4f3b70a21e89af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:49.534127 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2e22ffb6-0bf8-4a73-8f27-41a7cab88612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:49.609736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1362/2730] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:49.614558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:49.626641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639328b-c7c0-4246-8f5e-55af7820c703 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:49.632311 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:49.633027 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:49.633387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:49.633773 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:49.634651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:49.637191 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:49.693689 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1369/2731] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:27:49 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:27:49.698444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22ffb6-0bf8-4a73-8f27-41a7cab88612 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:49.710688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22ffb6-0bf8-4a73-8f27-41a7cab88612 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:49.777418 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:49.778100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:49.778381 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:49.778653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:49.779331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:49.781307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:49.810841 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1363/2732] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:27:49 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:27:49.814943 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:49.826432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5b5fb3-577e-422e-9b66-3e78296a971d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:49.831491 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:49.832149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:49.832464 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:49.832763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:49.833512 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:49.835495 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:49.849077 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1370/2733] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:27:49.853953 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:49.865159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b8b307-079a-4d64-96ad-651903c9e965 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:49.870617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:49.871397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:49.871863 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:49.872255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] PATH_INFO: `/v3/projects/2f829d9bcd654010bda97568b41e1e29/users/cc2236e49433408983c90db0fd63d0b1/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:49.883811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:49.891942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f829d9bcd654010bda97568b41e1e29, user_id=cc2236e49433408983c90db0fd63d0b1, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:49.894831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:49.909177 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1364/2734] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:49 2022] PUT /identity/v3/projects/2f829d9bcd654010bda97568b41e1e29/users/cc2236e49433408983c90db0fd63d0b1/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:49.913161 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:49.923595 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685377-4365-4301-821a-507054d567e9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:49.959301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:49.988044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9098ed-b09e-4b6d-8301-893b3d0a00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:49.988688 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9098ed-b09e-4b6d-8301-893b3d0a00c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:49.988963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9098ed-b09e-4b6d-8301-893b3d0a00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:49.989226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9098ed-b09e-4b6d-8301-893b3d0a00c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:49.989987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9098ed-b09e-4b6d-8301-893b3d0a00c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:49.992821 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9098ed-b09e-4b6d-8301-893b3d0a00c9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:50.009349 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1371/2735] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:27:50.011011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:50.022570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedf234-f9f2-4eb5-bc3b-2eef1c932cca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:50.028291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:50.030209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:50.030403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:50.030695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] PATH_INFO: `/v3/projects/2f829d9bcd654010bda97568b41e1e29/users/cc2236e49433408983c90db0fd63d0b1/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:50.032823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f829d9bcd654010bda97568b41e1e29, user_id=cc2236e49433408983c90db0fd63d0b1, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:50.035671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:50.048576 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1365/2736] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:27:50 2022] PUT /identity/v3/projects/2f829d9bcd654010bda97568b41e1e29/users/cc2236e49433408983c90db0fd63d0b1/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:27:54.619420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8781-1016-449d-8efe-f3d1fb7777db None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:54.620439 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8781-1016-449d-8efe-f3d1fb7777db None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:54.620926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a8781-1016-449d-8efe-f3d1fb7777db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:54.650997 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ca2a8781-1016-449d-8efe-f3d1fb7777db None None] MFA Rules not processed for user `cc2236e49433408983c90db0fd63d0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:54.652398 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ca2a8781-1016-449d-8efe-f3d1fb7777db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:54.737772 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1372/2737] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:54.753105 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:54.755317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:54.816984 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c4ba5-354c-46e6-9866-2100b5440467 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:54.820684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:54.821371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:54.821665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:54.821945 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:54.885186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:54.886793 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:54.895941 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1366/2738] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:55.046487 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:55.046785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:55.047067 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:55.066444 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:55.068419 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:55.161247 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1373/2739] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:55.190159 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:55.191613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:55.278688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871ece-f99d-4714-966f-2afbe620a840 service glance] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:55.284143 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bac89d-fab6-456b-a422-f33957f11579 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:55.284784 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bac89d-fab6-456b-a422-f33957f11579 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:55.285066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bac89d-fab6-456b-a422-f33957f11579 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:55.285967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bac89d-fab6-456b-a422-f33957f11579 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:55.302570 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bac89d-fab6-456b-a422-f33957f11579 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:55.304278 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bac89d-fab6-456b-a422-f33957f11579 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:55.316285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1367/2740] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:27:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:27:55.559736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:55.561290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:55.651249 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2638b4-1785-4de1-b4d8-4ddc05a34a94 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:55.659937 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:55.660988 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:55.661538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:55.662073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] PATH_INFO: `/v3/users/af15a4b01b084a0d8cc497fd2aa6ce66` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:55.663668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af15a4b01b084a0d8cc497fd2aa6ce66)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:55.665844 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:55.671928 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:55.733573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af15a4b01b084a0d8cc497fd2aa6ce66'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:55.744212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af15a4b01b084a0d8cc497fd2aa6ce66'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:55.761047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af15a4b01b084a0d8cc497fd2aa6ce66'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:55.762055 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af15a4b01b084a0d8cc497fd2aa6ce66'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:55.780471 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af15a4b01b084a0d8cc497fd2aa6ce66'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:55.788661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1374/2741] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:27:55 2022] DELETE /identity/v3/users/af15a4b01b084a0d8cc497fd2aa6ce66 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:27:55.793261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:55.794197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:55.794767 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:55.815669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:27:55.817020 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:55.831900 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:27:55.901317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1368/2742] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:27:55.912451 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:55.913920 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:55.989013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e0e-223c-4ee4-a889-18bb5e91f7c9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:55.993099 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:55.993747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:55.994072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:55.994346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:56.004711 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:56.006215 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:56.017162 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1375/2743] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:27:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:27:56.403372 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:27:56.404853 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:27:56.422684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fbaff-1ce1-4ce0-97af-cf3ec90c41a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:27:56.427504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:27:56.428182 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:27:56.428465 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:27:56.428738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] PATH_INFO: `/v3/projects/6972f289fb23447f955da4e2ce644a38` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:27:56.429981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6972f289fb23447f955da4e2ce644a38)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:27:56.431950 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:27:56.511578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6972f289fb23447f955da4e2ce644a38', 'request_id': 'req-26943ac3-854d-4cc0-a0da-b39c5f959bff'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:56.526613 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6972f289fb23447f955da4e2ce644a38', 'request_id': 'req-26943ac3-854d-4cc0-a0da-b39c5f959bff'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:56.543475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6972f289fb23447f955da4e2ce644a38', 'request_id': 'req-26943ac3-854d-4cc0-a0da-b39c5f959bff'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:56.561353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] The token cache is being invalidate because project 6972f289fb23447f955da4e2ce644a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:27:56.561742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:56.562552 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-26943ac3-854d-4cc0-a0da-b39c5f959bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:27:56.565405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1369/2744] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:27:56 2022] DELETE /identity/v3/projects/6972f289fb23447f955da4e2ce644a38 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:03.487306 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:03.489536 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:03.714516 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11650f0b-94f0-4478-a781-4bbd433a795f service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:03.796802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:03.862995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773647b-bd48-4891-be52-3f8ef33bcae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:03.864002 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773647b-bd48-4891-be52-3f8ef33bcae3 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:03.864752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773647b-bd48-4891-be52-3f8ef33bcae3 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:03.865189 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773647b-bd48-4891-be52-3f8ef33bcae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:03.867585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f773647b-bd48-4891-be52-3f8ef33bcae3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:03.885904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773647b-bd48-4891-be52-3f8ef33bcae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:03.888091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773647b-bd48-4891-be52-3f8ef33bcae3 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:03.906180 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1376/2745] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:04.456189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:04.456708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:04.456818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:04.477059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] MFA Rules not processed for user `3bf630b761f947e8a4f3b70a21e89af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:04.478324 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:04.557337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1370/2746] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:06.607390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:06.607909 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:06.608004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:06.627778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:06.629041 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:06.696467 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1377/2747] 10.222.0.17 () {58 vars in 1009 bytes} [Sat Aug 6 01:28:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:06.710891 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:06.713448 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:06.769272 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:06.804511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de1a10-431c-49ab-b099-55fd992d79b2 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:06.811039 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:06.811677 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:06.811955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:06.812243 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:06.823402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:06.825647 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:06.836843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1371/2748] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:28:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:28:08.387188 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:08.388751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:08.451567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594296a-e9a9-4fbb-aaf6-0a27836f5a5b None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:08.455318 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:08.455945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:08.456219 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:08.456486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:08.458454 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:08.537413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:08.539140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:08.551972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1378/2749] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:12.420989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:12.422994 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:12.438689 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66270a99-9a27-4144-9189-1ee6352576fa service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:12.453432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:12.454636 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:12.455316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:12.455875 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] PATH_INFO: `/v3/users/59e0b75ebfd64c5fa2a4dd012c6620be` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:12.457594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e0b75ebfd64c5fa2a4dd012c6620be)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:12.459966 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:12.561006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e0b75ebfd64c5fa2a4dd012c6620be'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:12.572111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e0b75ebfd64c5fa2a4dd012c6620be'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:12.572929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e0b75ebfd64c5fa2a4dd012c6620be'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:12.586967 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e0b75ebfd64c5fa2a4dd012c6620be'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:12.600400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-15026211-b6e6-4552-aebb-863ed9f5b9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e0b75ebfd64c5fa2a4dd012c6620be'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:12.620097 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1372/2750] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:12 2022] DELETE /identity/v3/users/59e0b75ebfd64c5fa2a4dd012c6620be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:12.803970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:12.811234 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:12.816582 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23dc69-f171-4bad-8c01-c4164663e492 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:12.906316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:12.907232 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:12.907578 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:12.907936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] PATH_INFO: `/v3/projects/26661aa682ec4574ae5879fa2e120253` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:12.909237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26661aa682ec4574ae5879fa2e120253)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:12.919575 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:12.992983 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26661aa682ec4574ae5879fa2e120253', 'request_id': 'req-dce267e4-536e-473b-a466-c5ecaa941861'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:13.004073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26661aa682ec4574ae5879fa2e120253', 'request_id': 'req-dce267e4-536e-473b-a466-c5ecaa941861'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:13.011642 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26661aa682ec4574ae5879fa2e120253', 'request_id': 'req-dce267e4-536e-473b-a466-c5ecaa941861'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:13.023448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] The token cache is being invalidate because project 26661aa682ec4574ae5879fa2e120253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:13.023799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:13.024409 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-dce267e4-536e-473b-a466-c5ecaa941861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:13.026202 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1379/2751] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:12 2022] DELETE /identity/v3/projects/26661aa682ec4574ae5879fa2e120253 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:13.031326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8e3f-f7a7-4b3b-b145-c29f32f0410e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.031719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8e3f-f7a7-4b3b-b145-c29f32f0410e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.032087 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8e3f-f7a7-4b3b-b145-c29f32f0410e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.052668 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f21a8e3f-f7a7-4b3b-b145-c29f32f0410e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:13.054123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f21a8e3f-f7a7-4b3b-b145-c29f32f0410e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:13.120230 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1373/2752] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:13.137524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cf6c-5acb-4a4f-92e4-e8e88d24cff1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.137845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cf6c-5acb-4a4f-92e4-e8e88d24cff1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.138177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cf6c-5acb-4a4f-92e4-e8e88d24cff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.167320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-2ee6cf6c-5acb-4a4f-92e4-e8e88d24cff1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:13.170441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-2ee6cf6c-5acb-4a4f-92e4-e8e88d24cff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:13.181856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1380/2753] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:13.186033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a8e3f-f7a7-4b3b-b145-c29f32f0410e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:13.205981 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a8e3f-f7a7-4b3b-b145-c29f32f0410e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:13.219986 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:13.221643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.222033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.222384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.223304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:28:13.223696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:13.226733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:13.242965 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1374/2754] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:28:13.247148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6cf6c-5acb-4a4f-92e4-e8e88d24cff1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:13.281047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6cf6c-5acb-4a4f-92e4-e8e88d24cff1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:13.287085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:13.287763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.293016 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.293392 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.294344 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:13.296453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:13.380524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1381/2755] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:13.381882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:13.417846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d17254-18ba-4953-929f-c0f5a8087eed admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:13.483669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:13.523555 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:13.524260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.524549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.524826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.525652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:13.529051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:13.560500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1375/2756] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:13 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:13.564663 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:13.576369 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41422e86-cd57-4767-ae27-379a135aa1ba admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:13.581216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:13.581843 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.582797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.582797 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.583359 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:13.584781 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:13.602819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1382/2757] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:28:13.603838 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:13.616925 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e50ce7-5bef-48f3-b8bb-7486245f98ea admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:13.624119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ffcb6-7a7b-4991-9189-696b51b974a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:13.625302 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffcb6-7a7b-4991-9189-696b51b974a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.625695 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffcb6-7a7b-4991-9189-696b51b974a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.626262 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ffcb6-7a7b-4991-9189-696b51b974a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.627517 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ffcb6-7a7b-4991-9189-696b51b974a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:13.630259 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5ffcb6-7a7b-4991-9189-696b51b974a7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:13.649775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1376/2758] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:13.654293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:13.665001 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0a990-5182-4ac0-b2b6-24cb434527cf admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:13.675301 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:13.676324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.676770 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.677227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] PATH_INFO: `/v3/projects/972ddd4a726d45bbbc2e678503478598/users/395fd9269f4c472082ca0c4062e0590e/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.711759 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972ddd4a726d45bbbc2e678503478598, user_id=395fd9269f4c472082ca0c4062e0590e, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:13.714742 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:13.749486 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1383/2759] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:13 2022] PUT /identity/v3/projects/972ddd4a726d45bbbc2e678503478598/users/395fd9269f4c472082ca0c4062e0590e/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:13.752594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c9a5-e428-4856-926f-9dba6a4fad53 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.752963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c9a5-e428-4856-926f-9dba6a4fad53 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.753239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c9a5-e428-4856-926f-9dba6a4fad53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.790389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-57a9c9a5-e428-4856-926f-9dba6a4fad53 None None] MFA Rules not processed for user `395fd9269f4c472082ca0c4062e0590e`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:13.792253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-57a9c9a5-e428-4856-926f-9dba6a4fad53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:13.874661 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1377/2760] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:13.879307 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:13.920193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:13.953242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d676cb8-0151-47b1-bc57-b1c3c8021ff6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:13.959284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:13.960399 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:13.960753 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:13.961028 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:13.961709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:13.963903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:13.999538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c9a5-e428-4856-926f-9dba6a4fad53 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.002226 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1384/2761] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:13 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:14.009211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.013680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:14.015180 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c9a5-e428-4856-926f-9dba6a4fad53 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.080820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a943b-4e3a-4722-8719-3fb5a8f67b7f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.085720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.086426 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.086702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.086972 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] PATH_INFO: `/v3/users/a4fb51a5013d4243a240874a7b162ce2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.088182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fb51a5013d4243a240874a7b162ce2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.090140 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.095568 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.098380 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.098851 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.099295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.100217 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.105719 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.146269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1378/2762] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:13 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:14.150593 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.163482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4ab1a-4ed9-414e-8072-5eb65469e43a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.170671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.171457 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.171864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.172253 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.173240 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.175009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.188427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1379/2763] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:14.192197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.194418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fb51a5013d4243a240874a7b162ce2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.203989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aeda66-2d7b-4e98-ace1-ef20a837d0ff admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.210314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.211573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.211983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.212357 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] PATH_INFO: `/v3/projects/1dd8efa6fb4d4a93a5fc09e3d60d0dff/users/bee3605cc10047cfa18dc09ee211357c/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.215622 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fb51a5013d4243a240874a7b162ce2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.232369 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd8efa6fb4d4a93a5fc09e3d60d0dff, user_id=bee3605cc10047cfa18dc09ee211357c, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.235413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.242463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fb51a5013d4243a240874a7b162ce2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.243459 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fb51a5013d4243a240874a7b162ce2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.246377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:14.252038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-997b2977-ea86-4b01-9ed3-876dc0cd6eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fb51a5013d4243a240874a7b162ce2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.260154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1385/2764] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:14 2022] DELETE /identity/v3/users/a4fb51a5013d4243a240874a7b162ce2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:14.262494 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1380/2765] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:14 2022] PUT /identity/v3/projects/1dd8efa6fb4d4a93a5fc09e3d60d0dff/users/bee3605cc10047cfa18dc09ee211357c/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:28:14.265103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.266975 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.267416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.271409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:14.274114 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.302646 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:14.304024 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:14.344707 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:14.354607 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c59ac-0844-4ab6-ba33-b45d15345116 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.382876 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1386/2766] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:14.393081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.394995 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:14.439770 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.440340 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.440617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.440938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.441988 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.443762 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.457602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1381/2767] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:14.458652 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.466434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945c9b9-294c-421e-b90b-91a6376b1f7d None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.469009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb2164c-293b-40e0-9692-0f8480f91b1f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.470296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.471670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.472037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.472361 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.474831 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e7093-9d27-4dca-9b63-574b3ae8f613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.475938 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e7093-9d27-4dca-9b63-574b3ae8f613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.476737 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e7093-9d27-4dca-9b63-574b3ae8f613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.477189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e7093-9d27-4dca-9b63-574b3ae8f613 admin admin] PATH_INFO: `/v3/projects/1dd8efa6fb4d4a93a5fc09e3d60d0dff/users/bee3605cc10047cfa18dc09ee211357c/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.479434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e7093-9d27-4dca-9b63-574b3ae8f613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd8efa6fb4d4a93a5fc09e3d60d0dff, user_id=bee3605cc10047cfa18dc09ee211357c, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.482119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e7093-9d27-4dca-9b63-574b3ae8f613 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.483729 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.486029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.495924 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1382/2768] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:14 2022] PUT /identity/v3/projects/1dd8efa6fb4d4a93a5fc09e3d60d0dff/users/bee3605cc10047cfa18dc09ee211357c/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:14.498335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1387/2769] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:28:14.515002 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.515354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.515832 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.551219 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] MFA Rules not processed for user `bee3605cc10047cfa18dc09ee211357c`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:14.553197 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:14.628879 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1383/2770] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:14.640095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.641533 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:14.709778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4911e-a630-4f55-ab9b-0adb5cbf3021 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.759290 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabac45e-5b4d-4d5b-955f-1c76533eaae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.759926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac45e-5b4d-4d5b-955f-1c76533eaae7 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.760205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac45e-5b4d-4d5b-955f-1c76533eaae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.760476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabac45e-5b4d-4d5b-955f-1c76533eaae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.770346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabac45e-5b4d-4d5b-955f-1c76533eaae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.771829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabac45e-5b4d-4d5b-955f-1c76533eaae7 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.782511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1388/2771] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:14.789738 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:14.791449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:14.808969 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:14.879185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d45924-2b9f-45f3-9f83-941eca74b7cb None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:14.886317 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:14.886983 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.887270 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.887540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] PATH_INFO: `/v3/projects/95e5e3b9720841c3a04ad0a63721d7f1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:14.888730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e5e3b9720841c3a04ad0a63721d7f1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:14.890747 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:14.948235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e5e3b9720841c3a04ad0a63721d7f1', 'request_id': 'req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.959068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e5e3b9720841c3a04ad0a63721d7f1', 'request_id': 'req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.966811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e5e3b9720841c3a04ad0a63721d7f1', 'request_id': 'req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.979032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] The token cache is being invalidate because project 95e5e3b9720841c3a04ad0a63721d7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:14.979389 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.980168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-3f9aac13-2f8d-4b1b-9e3a-48d5efdc1630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:14.982165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1384/2772] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:14 2022] DELETE /identity/v3/projects/95e5e3b9720841c3a04ad0a63721d7f1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:14.987258 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d6eb-cdfb-4f37-a422-0364e0913893 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:14.987741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d6eb-cdfb-4f37-a422-0364e0913893 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:14.988047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d6eb-cdfb-4f37-a422-0364e0913893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.011511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-6b35d6eb-cdfb-4f37-a422-0364e0913893 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:15.012829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-6b35d6eb-cdfb-4f37-a422-0364e0913893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.060727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:15.103602 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1389/2773] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:15.112028 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712921-32d2-4273-af8f-7dfda13a681e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.112314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712921-32d2-4273-af8f-7dfda13a681e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.112585 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712921-32d2-4273-af8f-7dfda13a681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.140284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-46712921-32d2-4273-af8f-7dfda13a681e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:15.141586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-46712921-32d2-4273-af8f-7dfda13a681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.153790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1385/2774] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:15.155045 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35d6eb-cdfb-4f37-a422-0364e0913893 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.166665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35d6eb-cdfb-4f37-a422-0364e0913893 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.178236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.179033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.179312 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.179611 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.180519 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:28:15.180984 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.182896 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.205256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1390/2775] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:28:15.206561 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712921-32d2-4273-af8f-7dfda13a681e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.219263 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712921-32d2-4273-af8f-7dfda13a681e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.224610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.225282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.225518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.225788 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.226880 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.229108 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.266160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.267442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1386/2776] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:15 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:15.268121 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.273663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.282047 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b3466-e864-4529-8f4e-dea93ca25d6d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.342107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa42c-68b7-4439-94db-97fd369459bd admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.346116 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.346775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.347074 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.347370 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] PATH_INFO: `/v3/users/395fd9269f4c472082ca0c4062e0590e` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.348013 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.348866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.349223 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.349419 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.349979 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=395fd9269f4c472082ca0c4062e0590e)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.350111 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.352533 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.353004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.376989 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1387/2777] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:15 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:28:15.381012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.389649 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:15.394000 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3267-7232-4fcb-925f-6b2f1c078b64 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.403591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.404809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.405139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.405859 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.407168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.409653 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.413747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '395fd9269f4c472082ca0c4062e0590e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:15.422116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1388/2778] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:28:15.423472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '395fd9269f4c472082ca0c4062e0590e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:15.425955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.436629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec4f9-b991-496e-ae37-185f538aaacf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.437720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '395fd9269f4c472082ca0c4062e0590e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:15.438558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '395fd9269f4c472082ca0c4062e0590e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:15.442405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.443025 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.443312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.443582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.444287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.446037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.447499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-a8866a58-1295-4d79-950e-796731aab074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '395fd9269f4c472082ca0c4062e0590e'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:15.454281 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1391/2779] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:15 2022] DELETE /identity/v3/users/395fd9269f4c472082ca0c4062e0590e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:15.460110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c12db-7963-400a-867a-03161df023ec None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.460497 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c12db-7963-400a-867a-03161df023ec None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.461282 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1389/2780] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:15.461420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c12db-7963-400a-867a-03161df023ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.469239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.471660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.486376 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c05c27-afa9-471b-b560-1c6696b22eb4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.488504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-fd9c12db-7963-400a-867a-03161df023ec None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:15.489793 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fd9c12db-7963-400a-867a-03161df023ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.553289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:15.561058 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692b439-c838-45f9-8b2f-423e166d8319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.562046 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b439-c838-45f9-8b2f-423e166d8319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.562384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b439-c838-45f9-8b2f-423e166d8319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.562774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b439-c838-45f9-8b2f-423e166d8319 admin admin] PATH_INFO: `/v3/projects/66dd79ac7db544d68b5dadbddfca45e0/users/db225caa625f4ac5b14512be9caaaac2/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.581821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692b439-c838-45f9-8b2f-423e166d8319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dd79ac7db544d68b5dadbddfca45e0, user_id=db225caa625f4ac5b14512be9caaaac2, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.583573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1392/2781] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:15.588149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692b439-c838-45f9-8b2f-423e166d8319 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.595702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c12db-7963-400a-867a-03161df023ec None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.597321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-fd9c12db-7963-400a-867a-03161df023ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.605790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1390/2782] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:15 2022] PUT /identity/v3/projects/66dd79ac7db544d68b5dadbddfca45e0/users/db225caa625f4ac5b14512be9caaaac2/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:28:15.616973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.617258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.617733 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.646974 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] MFA Rules not processed for user `db225caa625f4ac5b14512be9caaaac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:15.648248 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.667587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c12db-7963-400a-867a-03161df023ec None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.742389 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.743437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.743872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.744151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.748742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1391/2783] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:28:15.755955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:15.757742 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:15.817562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.817921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46058e-e628-43f7-9e70-844e0a470d86 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:15.819071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.821685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:15.823256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:15.823256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:15.823256 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:15.829870 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1393/2784] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:28:15.834405 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:15.836026 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:15.839998 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:15.846718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1392/2785] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:16.196685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:16.198639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:16.236834 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2912ff7-c569-4bb3-bfd2-05af367d1446 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:16.244142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:16.245293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:16.245418 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:16.245908 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] PATH_INFO: `/v3/projects/972ddd4a726d45bbbc2e678503478598` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:16.247579 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=972ddd4a726d45bbbc2e678503478598)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:16.254177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:16.316734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:16.322668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972ddd4a726d45bbbc2e678503478598', 'request_id': 'req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.348330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972ddd4a726d45bbbc2e678503478598', 'request_id': 'req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.356767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972ddd4a726d45bbbc2e678503478598', 'request_id': 'req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.368179 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] The token cache is being invalidate because project 972ddd4a726d45bbbc2e678503478598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:16.368448 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.369126 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.371151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1394/2786] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:16 2022] DELETE /identity/v3/projects/972ddd4a726d45bbbc2e678503478598 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:16.375008 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:16.386296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317ddc2-9a02-49f1-ad3e-f0dd79598a87 service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:16.440279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:16.440929 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:16.441212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:16.441488 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] PATH_INFO: `/v3/users/bee3605cc10047cfa18dc09ee211357c` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:16.442674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee3605cc10047cfa18dc09ee211357c)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:16.444617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:16.492544 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee3605cc10047cfa18dc09ee211357c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.499956 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee3605cc10047cfa18dc09ee211357c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.500782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee3605cc10047cfa18dc09ee211357c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.520284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee3605cc10047cfa18dc09ee211357c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.528590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-81d45027-9a79-4d28-b503-8ecdd4c8aef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee3605cc10047cfa18dc09ee211357c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.535906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1393/2787] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:16 2022] DELETE /identity/v3/users/bee3605cc10047cfa18dc09ee211357c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:28:16.824098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:16.825845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:16.840242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afccad-b1d6-49a9-87d1-6dcf8cf891cc admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:16.897425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:16.898103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:16.898378 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:16.898647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] PATH_INFO: `/v3/projects/1dd8efa6fb4d4a93a5fc09e3d60d0dff` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:16.899825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd8efa6fb4d4a93a5fc09e3d60d0dff)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:16.901807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:16.958463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd8efa6fb4d4a93a5fc09e3d60d0dff', 'request_id': 'req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.969169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd8efa6fb4d4a93a5fc09e3d60d0dff', 'request_id': 'req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.974932 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd8efa6fb4d4a93a5fc09e3d60d0dff', 'request_id': 'req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.987260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] The token cache is being invalidate because project 1dd8efa6fb4d4a93a5fc09e3d60d0dff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:16.987619 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.988557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-652cfaf8-545f-47ba-b1b1-66d3fd2ea132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:16.990987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1395/2788] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:16 2022] DELETE /identity/v3/projects/1dd8efa6fb4d4a93a5fc09e3d60d0dff => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:16.996012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82497f9a-d579-4cbc-9cd5-c1912b2c3c4b None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:16.996492 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82497f9a-d579-4cbc-9cd5-c1912b2c3c4b None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:16.996589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82497f9a-d579-4cbc-9cd5-c1912b2c3c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.016351 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-82497f9a-d579-4cbc-9cd5-c1912b2c3c4b None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:17.017469 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-82497f9a-d579-4cbc-9cd5-c1912b2c3c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:17.080201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1394/2789] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:17.088182 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9546-1943-408f-8b10-ed305e424858 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.088465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9546-1943-408f-8b10-ed305e424858 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.088771 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9546-1943-408f-8b10-ed305e424858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.110593 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f6ee9546-1943-408f-8b10-ed305e424858 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:17.111856 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f6ee9546-1943-408f-8b10-ed305e424858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:17.121485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1396/2790] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:17.125911 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82497f9a-d579-4cbc-9cd5-c1912b2c3c4b None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.136269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82497f9a-d579-4cbc-9cd5-c1912b2c3c4b None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.141650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.142312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.142595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.142866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.143566 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:28:17.143870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.145480 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.157335 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1395/2791] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:28:17.161648 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9546-1943-408f-8b10-ed305e424858 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.171291 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9546-1943-408f-8b10-ed305e424858 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.176270 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.176874 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.177150 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.177417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.178106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.180037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.209097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1397/2792] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:17 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:17.213507 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.220075 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:17.224370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d915f71-383f-4350-bf9a-6b67ff3d6259 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.286009 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.286659 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.286943 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.287286 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.287885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.289993 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.333959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1396/2793] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:17 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:17.335326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.347526 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50be8bc-7722-4ea0-b4c8-531684b11b05 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.356945 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.357740 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.358175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.360293 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.361496 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.363363 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.385407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1398/2794] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:17.386731 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.398236 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b38870-a59c-470a-943d-0ac4ab0d3add admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.403757 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c07d6d-ac87-400e-bab1-606e6e459310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.404400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07d6d-ac87-400e-bab1-606e6e459310 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.404663 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07d6d-ac87-400e-bab1-606e6e459310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.404936 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c07d6d-ac87-400e-bab1-606e6e459310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.405631 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c07d6d-ac87-400e-bab1-606e6e459310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.407289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c07d6d-ac87-400e-bab1-606e6e459310 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.420390 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1397/2795] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:17.424613 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.435573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba2be-2584-411a-ade8-f70281975f1d admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.440563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.441243 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.441520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.441819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] PATH_INFO: `/v3/projects/c49f9d272ae14798bd30d6e609d8507d/users/5e458bbe8849463eb5445c0317c7c96b/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.458211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49f9d272ae14798bd30d6e609d8507d, user_id=5e458bbe8849463eb5445c0317c7c96b, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.461950 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.476699 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:17.484558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1399/2796] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:17 2022] PUT /identity/v3/projects/c49f9d272ae14798bd30d6e609d8507d/users/5e458bbe8849463eb5445c0317c7c96b/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:28:17.495754 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fa50-69cb-4b74-92fc-9dbbffe9b2b3 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.496116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fa50-69cb-4b74-92fc-9dbbffe9b2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.496486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03fa50-69cb-4b74-92fc-9dbbffe9b2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.531542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-dd03fa50-69cb-4b74-92fc-9dbbffe9b2b3 None None] MFA Rules not processed for user `5e458bbe8849463eb5445c0317c7c96b`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:17.532890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-dd03fa50-69cb-4b74-92fc-9dbbffe9b2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:17.607796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1398/2797] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:17.612627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.732677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0f247-44ad-4a3f-8ce6-3148182f04dd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.739048 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.740139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.740635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.741142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.742122 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.744453 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.778400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1400/2798] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:17 2022] POST /identity/v3/projects => generated 369 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:28:17.783014 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fa50-69cb-4b74-92fc-9dbbffe9b2b3 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.795032 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03fa50-69cb-4b74-92fc-9dbbffe9b2b3 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.860660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.861399 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.861759 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.862130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.862873 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.865052 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.889849 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1399/2799] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:17 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:17.894432 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.909768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84819834-24ed-4a02-9c17-3d018cd024fd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.914538 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.915168 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.915506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.915886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.916567 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.918211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.929615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1401/2800] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:17.933918 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.939200 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:17.946130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb7d75-6ad3-4acc-81a5-53d9dabf64f7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:17.951356 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:17.952031 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:17.952320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:17.952587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] PATH_INFO: `/v3/projects/fd317e75e7874d438fdc927dc4dd9279/users/7f0972761f4146e4b50d7151523a797c/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:17.967342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd317e75e7874d438fdc927dc4dd9279, user_id=7f0972761f4146e4b50d7151523a797c, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:17.970022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:17.984279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1400/2801] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:17 2022] PUT /identity/v3/projects/fd317e75e7874d438fdc927dc4dd9279/users/7f0972761f4146e4b50d7151523a797c/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:17.988368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:17.998739 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf80d5-a924-402a-b141-2683a12c2e6f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:18.059129 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6f890-4017-4010-8e10-dae2c92582dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:18.059674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f890-4017-4010-8e10-dae2c92582dd admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:18.059955 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f890-4017-4010-8e10-dae2c92582dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:18.060224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6f890-4017-4010-8e10-dae2c92582dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:18.060923 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6f890-4017-4010-8e10-dae2c92582dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:18.062562 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6f890-4017-4010-8e10-dae2c92582dd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:18.072807 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1402/2802] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:18.078239 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:18.089209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8beb693-4eb8-47fc-9e97-f82e03f60b19 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:18.094312 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:18.094985 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:18.095260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:18.095532 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] PATH_INFO: `/v3/projects/fd317e75e7874d438fdc927dc4dd9279/users/7f0972761f4146e4b50d7151523a797c/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:18.097580 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd317e75e7874d438fdc927dc4dd9279, user_id=7f0972761f4146e4b50d7151523a797c, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:18.100307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:18.111130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1401/2803] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:18 2022] PUT /identity/v3/projects/fd317e75e7874d438fdc927dc4dd9279/users/7f0972761f4146e4b50d7151523a797c/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:18.122525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef2fcc-efec-40c4-8362-18999e04f69a None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:18.122836 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef2fcc-efec-40c4-8362-18999e04f69a None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:18.123106 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef2fcc-efec-40c4-8362-18999e04f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:18.152752 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-78ef2fcc-efec-40c4-8362-18999e04f69a None None] MFA Rules not processed for user `7f0972761f4146e4b50d7151523a797c`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:18.154026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-78ef2fcc-efec-40c4-8362-18999e04f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:18.218498 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:18.231294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1403/2804] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:28:18.242776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:18.244710 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:18.305184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d66c1-34ed-48fd-b3ca-1a11e173b5f9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:18.308904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e1c74-4f2d-4fc6-ba6e-0029db032ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:18.309612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1c74-4f2d-4fc6-ba6e-0029db032ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:18.309819 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1c74-4f2d-4fc6-ba6e-0029db032ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:18.310156 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e1c74-4f2d-4fc6-ba6e-0029db032ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:18.319411 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1c74-4f2d-4fc6-ba6e-0029db032ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:18.320877 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e1c74-4f2d-4fc6-ba6e-0029db032ec3 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:18.330775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1402/2805] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:19.812990 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef2fcc-efec-40c4-8362-18999e04f69a None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:19.878345 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef2fcc-efec-40c4-8362-18999e04f69a None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:19.883480 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:19.884115 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:19.884415 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:19.884687 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] PATH_INFO: `/v3/users/5e458bbe8849463eb5445c0317c7c96b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:19.885866 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e458bbe8849463eb5445c0317c7c96b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:19.888029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:19.937546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e458bbe8849463eb5445c0317c7c96b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:19.946175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e458bbe8849463eb5445c0317c7c96b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:19.958913 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e458bbe8849463eb5445c0317c7c96b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:19.959632 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e458bbe8849463eb5445c0317c7c96b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:19.967053 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e458bbe8849463eb5445c0317c7c96b'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:19.973617 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1404/2806] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:19 2022] DELETE /identity/v3/users/5e458bbe8849463eb5445c0317c7c96b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:19.978460 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:19.978840 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:19.979003 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:19.998511 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:19.999725 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:20.059637 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1403/2807] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:20.069504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:20.070951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:20.131963 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82c70b-0693-4c49-9adc-e8516e0db7cf admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:20.135981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:20.136598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:20.136872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:20.137138 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:20.146408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:20.148131 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:20.157764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1405/2808] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:28:20.780669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:20.782246 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:20.803862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeae2d-b0cb-43e0-a0be-bd82ad930dc7 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:20.811564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:20.812479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:20.812845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:20.813204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] PATH_INFO: `/v3/projects/c49f9d272ae14798bd30d6e609d8507d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:20.814510 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49f9d272ae14798bd30d6e609d8507d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:20.816506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:20.865030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49f9d272ae14798bd30d6e609d8507d', 'request_id': 'req-6ade5720-e135-4469-b197-0c2e73ca60bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:20.874852 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49f9d272ae14798bd30d6e609d8507d', 'request_id': 'req-6ade5720-e135-4469-b197-0c2e73ca60bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:20.880404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:20.881609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49f9d272ae14798bd30d6e609d8507d', 'request_id': 'req-6ade5720-e135-4469-b197-0c2e73ca60bf'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:20.894749 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] The token cache is being invalidate because project c49f9d272ae14798bd30d6e609d8507d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:20.895035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:20.895682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:20.897216 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1404/2809] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:20 2022] DELETE /identity/v3/projects/c49f9d272ae14798bd30d6e609d8507d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:20.901254 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:20.911211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a7bc2d-d060-4d48-af2d-675653b01cd3 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:20.924282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:20.975030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:20.976022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:20.976300 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:20.976569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] PATH_INFO: `/v3/users/7f0972761f4146e4b50d7151523a797c` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:20.977743 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0972761f4146e4b50d7151523a797c)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:20.979736 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:21.029236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0972761f4146e4b50d7151523a797c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.037776 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0972761f4146e4b50d7151523a797c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.050463 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0972761f4146e4b50d7151523a797c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.051158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0972761f4146e4b50d7151523a797c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.058197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-b3962c48-cddc-4330-82e6-69e12ad600a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0972761f4146e4b50d7151523a797c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.064677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1406/2810] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:20 2022] DELETE /identity/v3/users/7f0972761f4146e4b50d7151523a797c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:21.446921 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:21.448540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:21.463430 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade5720-e135-4469-b197-0c2e73ca60bf admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:21.533982 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:21.534923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:21.535305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:21.535683 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] PATH_INFO: `/v3/projects/fd317e75e7874d438fdc927dc4dd9279` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:21.537215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd317e75e7874d438fdc927dc4dd9279)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:21.539708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:21.590341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd317e75e7874d438fdc927dc4dd9279', 'request_id': 'req-e24c7bea-6be9-40bd-a4cb-762459006fe4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.597776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd317e75e7874d438fdc927dc4dd9279', 'request_id': 'req-e24c7bea-6be9-40bd-a4cb-762459006fe4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.603904 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd317e75e7874d438fdc927dc4dd9279', 'request_id': 'req-e24c7bea-6be9-40bd-a4cb-762459006fe4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.616364 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] The token cache is being invalidate because project fd317e75e7874d438fdc927dc4dd9279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:21.616650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.617384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-e24c7bea-6be9-40bd-a4cb-762459006fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:21.619109 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1405/2811] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:21 2022] DELETE /identity/v3/projects/fd317e75e7874d438fdc927dc4dd9279 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:21.624343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f55ac0-13c9-4a40-94ba-90173abb8bf1 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:21.624820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f55ac0-13c9-4a40-94ba-90173abb8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:21.625095 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f55ac0-13c9-4a40-94ba-90173abb8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:21.649090 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-00f55ac0-13c9-4a40-94ba-90173abb8bf1 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:21.650560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-00f55ac0-13c9-4a40-94ba-90173abb8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:21.713305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1407/2812] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:28:21.721586 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2d5fd-e0ee-45b9-bb9a-301bb4f4f4a5 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:21.721821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2d5fd-e0ee-45b9-bb9a-301bb4f4f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:21.722131 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2d5fd-e0ee-45b9-bb9a-301bb4f4f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:21.744446 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-1cb2d5fd-e0ee-45b9-bb9a-301bb4f4f4a5 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:21.745688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-1cb2d5fd-e0ee-45b9-bb9a-301bb4f4f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:21.757010 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1406/2813] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:28:21.758256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f55ac0-13c9-4a40-94ba-90173abb8bf1 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:21.769082 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f55ac0-13c9-4a40-94ba-90173abb8bf1 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:21.774156 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:21.775573 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:21.775968 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:21.776360 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:21.777284 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:28:21.777588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:21.779513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:21.793105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1408/2814] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:28:21.797579 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2d5fd-e0ee-45b9-bb9a-301bb4f4f4a5 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:21.807373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2d5fd-e0ee-45b9-bb9a-301bb4f4f4a5 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:21.812476 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:21.813095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:21.813368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:21.813691 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:21.814396 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:21.816352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:21.856024 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1407/2815] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:21 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:21.860034 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:21.870354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90a96a-a98e-4980-975b-7641ede1b617 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:21.891072 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:21.933008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:21.933620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:21.934062 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:21.934333 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:21.935054 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:21.937123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:21.958857 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1409/2816] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:21 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:21.963483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:21.977045 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9883d95-a9ab-4384-b0ce-a50027909cba admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:21.982540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:21.983152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:21.983432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:21.983674 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:21.984402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:21.985996 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:21.996560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1408/2817] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:28:22.000720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:22.011802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9068e-63c7-4f16-bdae-d06b845a84c7 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:22.016672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce83363-3e6e-4f41-a984-c2b14ada1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:22.017288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83363-3e6e-4f41-a984-c2b14ada1275 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:22.017568 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83363-3e6e-4f41-a984-c2b14ada1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:22.017839 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce83363-3e6e-4f41-a984-c2b14ada1275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:22.018596 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce83363-3e6e-4f41-a984-c2b14ada1275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:22.020203 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce83363-3e6e-4f41-a984-c2b14ada1275 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:22.033858 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1410/2818] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:22.035051 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:22.055366 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9c0fb-6d52-4540-8ca0-9dd38dd98748 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:22.061094 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:22.061799 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:22.062141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:22.062436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] PATH_INFO: `/v3/projects/85b97ea064454f93baec7dc71bc58b33/users/74098176850947c78070d426c4b5d627/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:22.080592 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b97ea064454f93baec7dc71bc58b33, user_id=74098176850947c78070d426c4b5d627, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:22.083336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:22.098758 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1409/2819] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:22 2022] PUT /identity/v3/projects/85b97ea064454f93baec7dc71bc58b33/users/74098176850947c78070d426c4b5d627/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:22.113511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:22.113802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:22.114151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:22.144564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] MFA Rules not processed for user `74098176850947c78070d426c4b5d627`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:22.145903 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:22.220912 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1411/2820] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:22.232402 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:22.234233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:22.255123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:22.297722 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6365a-3646-46a3-aac6-e5ef2a21aac5 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:22.301435 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d709da8-a272-4623-8506-e4fd44b8da72 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0131e4a3492c42c492c47a715a2bccaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:22.302122 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709da8-a272-4623-8506-e4fd44b8da72 service glance] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:22.302406 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709da8-a272-4623-8506-e4fd44b8da72 service glance] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:22.303029 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d709da8-a272-4623-8506-e4fd44b8da72 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:22.312225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709da8-a272-4623-8506-e4fd44b8da72 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:22.313835 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d709da8-a272-4623-8506-e4fd44b8da72 service glance] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:22.324069 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1410/2821] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:26.072289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:26.073879 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:26.156326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b676b22-651d-43d6-bb1d-46585220c4d7 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:26.161087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:26.161747 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:26.162159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:26.162443 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] PATH_INFO: `/v3/users/db225caa625f4ac5b14512be9caaaac2` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:26.163465 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db225caa625f4ac5b14512be9caaaac2)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:26.165417 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:26.210977 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:26.216476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db225caa625f4ac5b14512be9caaaac2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.224641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db225caa625f4ac5b14512be9caaaac2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.237395 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db225caa625f4ac5b14512be9caaaac2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.238154 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db225caa625f4ac5b14512be9caaaac2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.245506 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db225caa625f4ac5b14512be9caaaac2'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.253212 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1412/2822] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:26 2022] DELETE /identity/v3/users/db225caa625f4ac5b14512be9caaaac2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:26.258479 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:26.259077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:26.259165 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:26.285922 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:26.287289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:26.346973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1411/2823] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:26.357589 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:26.359246 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:26.417686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477c66d-d850-4d9b-b42f-5fd002d700d4 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:26.421907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:26.422550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:26.422880 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:26.423148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:26.432748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:26.434296 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:26.443783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1413/2824] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:26.722923 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:26.724543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:26.738076 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff653fc2-2ee6-46f6-9934-21c0726acf8e None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:26.744192 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:26.744826 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:26.745113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:26.745386 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] PATH_INFO: `/v3/projects/66dd79ac7db544d68b5dadbddfca45e0` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:26.746685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=66dd79ac7db544d68b5dadbddfca45e0)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:26.748644 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:26.801612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66dd79ac7db544d68b5dadbddfca45e0', 'request_id': 'req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.811336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66dd79ac7db544d68b5dadbddfca45e0', 'request_id': 'req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.818139 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66dd79ac7db544d68b5dadbddfca45e0', 'request_id': 'req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.829513 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] The token cache is being invalidate because project 66dd79ac7db544d68b5dadbddfca45e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:26.829798 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.830562 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:26.832281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1412/2825] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:26 2022] DELETE /identity/v3/projects/66dd79ac7db544d68b5dadbddfca45e0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:28.644822 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:28.646721 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:28.660702 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d3934-52b6-42aa-b5b1-2623cc66f0b6 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:28.715058 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26985e4c-3e17-4a51-9e52-c6b49b6ffec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:28.715673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985e4c-3e17-4a51-9e52-c6b49b6ffec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:28.715948 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985e4c-3e17-4a51-9e52-c6b49b6ffec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:28.716216 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26985e4c-3e17-4a51-9e52-c6b49b6ffec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:28.718368 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-26985e4c-3e17-4a51-9e52-c6b49b6ffec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:28.789504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985e4c-3e17-4a51-9e52-c6b49b6ffec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:28.791169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26985e4c-3e17-4a51-9e52-c6b49b6ffec2 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:28.802105 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1414/2826] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:36.826588 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:38.797286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:39.044341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:39.046056 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:39.200949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d84495-1441-4f94-8a79-85a8d5b3f6ba admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:39.206326 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:39.206970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:39.207247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:39.207519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] PATH_INFO: `/v3/users/74098176850947c78070d426c4b5d627` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:39.208756 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74098176850947c78070d426c4b5d627)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:39.210724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:39.260581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74098176850947c78070d426c4b5d627'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.267444 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74098176850947c78070d426c4b5d627'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.268130 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74098176850947c78070d426c4b5d627'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.280696 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74098176850947c78070d426c4b5d627'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.288072 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74098176850947c78070d426c4b5d627'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.294257 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1413/2827] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:39 2022] DELETE /identity/v3/users/74098176850947c78070d426c4b5d627 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:39.298875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:39.299158 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:39.299427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:39.327081 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:39.328302 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:39.389749 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1415/2828] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:39.400068 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:39.401633 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:39.422699 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:39.478660 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415da542-b62d-4526-8d15-92cef4c99613 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:39.482874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe5987-b07e-48e3-9ad8-e614759e98bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:39.483504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe5987-b07e-48e3-9ad8-e614759e98bb service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:39.483790 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe5987-b07e-48e3-9ad8-e614759e98bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:39.484061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe5987-b07e-48e3-9ad8-e614759e98bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:39.494305 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe5987-b07e-48e3-9ad8-e614759e98bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:39.495854 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe5987-b07e-48e3-9ad8-e614759e98bb service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:39.506337 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1414/2829] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:39.784987 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:39.786585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:39.799558 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4c23e-edff-4fb4-9836-a617038ca2bf None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:39.804686 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:39.805343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:39.806521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:39.807230 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] PATH_INFO: `/v3/projects/85b97ea064454f93baec7dc71bc58b33` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:39.808541 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b97ea064454f93baec7dc71bc58b33)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:39.810524 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:39.859335 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b97ea064454f93baec7dc71bc58b33', 'request_id': 'req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.867004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b97ea064454f93baec7dc71bc58b33', 'request_id': 'req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.872708 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b97ea064454f93baec7dc71bc58b33', 'request_id': 'req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.883720 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] The token cache is being invalidate because project 85b97ea064454f93baec7dc71bc58b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:39.884007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.884700 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-129ee8e4-bea0-485c-9d32-4ed37caa2b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:39.886390 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1416/2830] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:39 2022] DELETE /identity/v3/projects/85b97ea064454f93baec7dc71bc58b33 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:39.891436 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fc914-862a-4926-b97e-22e30eb7bada None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:39.891807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fc914-862a-4926-b97e-22e30eb7bada None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:39.892077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853fc914-862a-4926-b97e-22e30eb7bada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:39.948560 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-853fc914-862a-4926-b97e-22e30eb7bada None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:39.949970 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-853fc914-862a-4926-b97e-22e30eb7bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:40.012189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1415/2831] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:40.020148 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e29cb-b816-40a9-a90c-5010048b3793 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.020423 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e29cb-b816-40a9-a90c-5010048b3793 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.020709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e29cb-b816-40a9-a90c-5010048b3793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.040767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-e21e29cb-b816-40a9-a90c-5010048b3793 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:40.041967 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-e21e29cb-b816-40a9-a90c-5010048b3793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:40.050697 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1417/2832] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:40.055018 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fc914-862a-4926-b97e-22e30eb7bada None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.065397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853fc914-862a-4926-b97e-22e30eb7bada None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.071115 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.071836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.072118 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.072384 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.073082 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:28:40.073385 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.075138 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.087410 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1416/2833] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:28:40.091816 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e29cb-b816-40a9-a90c-5010048b3793 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.102169 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e29cb-b816-40a9-a90c-5010048b3793 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.108196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.108802 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.109080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.109618 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.110310 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.112221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.143149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1418/2834] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:40 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:40.147400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.158547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9262f-6447-4a5f-ac25-9868d35c5db8 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.217330 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.217878 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.218164 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.218462 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.219123 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.221061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.239486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:40.247715 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1417/2835] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:40 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:40.251886 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.262961 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fae6b-edf0-4499-be5e-cacaa1b8e495 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.268266 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.268877 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.269151 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.269442 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.270164 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.271769 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.282017 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1419/2836] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:40.285889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.296724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577a341-36cb-4641-b96b-f18f4c76517c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.302170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1c2d2-9967-4ba5-8da2-d00af880fbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.302774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c2d2-9967-4ba5-8da2-d00af880fbdd admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.303053 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c2d2-9967-4ba5-8da2-d00af880fbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.303318 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c2d2-9967-4ba5-8da2-d00af880fbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.304701 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1c2d2-9967-4ba5-8da2-d00af880fbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.306336 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1c2d2-9967-4ba5-8da2-d00af880fbdd admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.317204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1418/2837] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:40.321322 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.331675 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545d4a0-a510-4456-9bb3-5b3f8fa4f1ae admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.336718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.337379 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.337653 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.337946 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] PATH_INFO: `/v3/projects/2a15fe5e953b44a0a568ea12bb11f7e4/users/9251bf3362f746978e8ba2d1e4f5ba52/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.354784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a15fe5e953b44a0a568ea12bb11f7e4, user_id=9251bf3362f746978e8ba2d1e4f5ba52, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.357957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.372393 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1420/2838] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:40 2022] PUT /identity/v3/projects/2a15fe5e953b44a0a568ea12bb11f7e4/users/9251bf3362f746978e8ba2d1e4f5ba52/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:40.382937 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eb043-f2ba-4e9a-bd11-3ba8a55b4f49 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.383229 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eb043-f2ba-4e9a-bd11-3ba8a55b4f49 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.383500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961eb043-f2ba-4e9a-bd11-3ba8a55b4f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.416207 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-961eb043-f2ba-4e9a-bd11-3ba8a55b4f49 None None] MFA Rules not processed for user `9251bf3362f746978e8ba2d1e4f5ba52`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:40.417432 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-961eb043-f2ba-4e9a-bd11-3ba8a55b4f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:40.485610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1419/2839] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:28:40.518639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.520449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:40.535789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:40.580546 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f653a-811f-4d82-b0dc-8fc596991e3e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.584469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40ff27-7902-44f5-878e-eaabe3788e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.585097 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40ff27-7902-44f5-878e-eaabe3788e96 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.585374 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40ff27-7902-44f5-878e-eaabe3788e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.585641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40ff27-7902-44f5-878e-eaabe3788e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.594196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40ff27-7902-44f5-878e-eaabe3788e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.595634 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40ff27-7902-44f5-878e-eaabe3788e96 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.604763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1421/2840] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:40.619932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eb043-f2ba-4e9a-bd11-3ba8a55b4f49 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.683129 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961eb043-f2ba-4e9a-bd11-3ba8a55b4f49 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.688622 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.689269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.689547 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.689818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] PATH_INFO: `/v3/users/9251bf3362f746978e8ba2d1e4f5ba52` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.691184 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9251bf3362f746978e8ba2d1e4f5ba52)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.693279 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.744185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9251bf3362f746978e8ba2d1e4f5ba52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:40.750942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9251bf3362f746978e8ba2d1e4f5ba52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:40.751680 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9251bf3362f746978e8ba2d1e4f5ba52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:40.766162 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9251bf3362f746978e8ba2d1e4f5ba52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:40.769811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:40.774550 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9251bf3362f746978e8ba2d1e4f5ba52'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:40.781591 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1420/2841] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:40 2022] DELETE /identity/v3/users/9251bf3362f746978e8ba2d1e4f5ba52 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:40.786236 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.786520 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.786794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.806485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:40.807680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:40.870528 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1422/2842] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:40.880484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:40.882022 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:40.943617 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa31e0-a2fd-48df-b6fc-1b0049bec52a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:40.947564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7b994-8363-4f1b-91aa-96b152199c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:40.948181 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b994-8363-4f1b-91aa-96b152199c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:40.948459 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b994-8363-4f1b-91aa-96b152199c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:40.948813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b994-8363-4f1b-91aa-96b152199c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:40.958320 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7b994-8363-4f1b-91aa-96b152199c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:40.959807 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d7b994-8363-4f1b-91aa-96b152199c45 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:40.969962 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1421/2843] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:41.248123 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.249668 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:41.264884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f49951-bfa2-464f-b0e7-748195a67295 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.270292 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.270951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.271224 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.272265 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] PATH_INFO: `/v3/projects/2a15fe5e953b44a0a568ea12bb11f7e4` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.273853 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a15fe5e953b44a0a568ea12bb11f7e4)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:41.275809 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:41.325673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a15fe5e953b44a0a568ea12bb11f7e4', 'request_id': 'req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:41.334346 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a15fe5e953b44a0a568ea12bb11f7e4', 'request_id': 'req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:41.342468 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a15fe5e953b44a0a568ea12bb11f7e4', 'request_id': 'req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:41.355338 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] The token cache is being invalidate because project 2a15fe5e953b44a0a568ea12bb11f7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80180) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:41.355620 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:41.356288 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-91ebd75d-87ba-4c5d-afba-fe60f7ec1597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:41.358030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1423/2844] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:41 2022] DELETE /identity/v3/projects/2a15fe5e953b44a0a568ea12bb11f7e4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:41.363012 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c6eb7-f3f0-4dca-a57a-5de15f5db484 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.363496 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c6eb7-f3f0-4dca-a57a-5de15f5db484 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.363595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c6eb7-f3f0-4dca-a57a-5de15f5db484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.383098 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-5f6c6eb7-f3f0-4dca-a57a-5de15f5db484 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:41.384291 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-5f6c6eb7-f3f0-4dca-a57a-5de15f5db484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:41.445113 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1422/2845] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:41.454227 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab545-66a2-4e8a-9492-96850a367eae None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.454504 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab545-66a2-4e8a-9492-96850a367eae None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.454775 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab545-66a2-4e8a-9492-96850a367eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.476650 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-042ab545-66a2-4e8a-9492-96850a367eae None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:41.477884 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-042ab545-66a2-4e8a-9492-96850a367eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:41.487411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1424/2846] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:28:41.492037 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c6eb7-f3f0-4dca-a57a-5de15f5db484 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.503338 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c6eb7-f3f0-4dca-a57a-5de15f5db484 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.509319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.509889 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.510252 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.510523 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.511267 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80181) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:28:41.511575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:41.513189 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:41.526168 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1423/2847] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:28:41.531005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab545-66a2-4e8a-9492-96850a367eae None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.540691 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab545-66a2-4e8a-9492-96850a367eae None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.546020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.546639 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.546915 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.547210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.547888 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:41.549823 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:41.580550 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1425/2848] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:41 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:41.584721 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.595033 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2263b-2811-42c6-8e9f-1884468d18e7 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.651811 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.652434 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.652714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.652987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.653665 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:41.655645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:41.677992 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1424/2849] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:41 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:28:41.681998 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.692545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c7821-c6a0-4ae0-9cac-b1c067524886 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.697904 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.698763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.699011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.699305 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.700005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:41.702029 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:41.707949 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:41.716525 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1426/2850] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:41.717910 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.728847 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae81de5-b43c-46fc-b04c-5ffd5a678255 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.734903 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde2540-780d-46bf-8ea4-022efa21c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.735519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2540-780d-46bf-8ea4-022efa21c377 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.735813 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2540-780d-46bf-8ea4-022efa21c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.736085 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde2540-780d-46bf-8ea4-022efa21c377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.736785 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde2540-780d-46bf-8ea4-022efa21c377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:41.738483 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde2540-780d-46bf-8ea4-022efa21c377 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:41.749944 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1425/2851] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:41.754713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.770933 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde93045-6f90-4d56-8faa-cf0c98616182 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.778665 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.779329 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.779601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.779867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] PATH_INFO: `/v3/projects/b9abd0125b71482e883586f237092456/users/25e5785e63af49ae97944e25acffaf80/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.795864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9abd0125b71482e883586f237092456, user_id=25e5785e63af49ae97944e25acffaf80, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:41.798566 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:41.814080 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1427/2852] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:41 2022] PUT /identity/v3/projects/b9abd0125b71482e883586f237092456/users/25e5785e63af49ae97944e25acffaf80/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:41.824595 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191dda5-125f-4a78-b4d8-d686dae19d44 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.824885 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191dda5-125f-4a78-b4d8-d686dae19d44 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.825161 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191dda5-125f-4a78-b4d8-d686dae19d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.834303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:41.855796 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-2191dda5-125f-4a78-b4d8-d686dae19d44 None None] MFA Rules not processed for user `25e5785e63af49ae97944e25acffaf80`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:41.857019 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-2191dda5-125f-4a78-b4d8-d686dae19d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:41.922169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1426/2853] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:41.926914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:41.990501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4d6a2-ac24-4c62-bd7a-f1c5008b57d9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:41.996303 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:41.996917 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:41.997193 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:41.997456 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:41.998143 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.000035 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.031079 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1428/2854] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:41 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:42.035163 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191dda5-125f-4a78-b4d8-d686dae19d44 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.045949 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191dda5-125f-4a78-b4d8-d686dae19d44 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.104582 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.105314 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.105594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.105882 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.106614 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.108565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.134581 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1427/2855] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:42 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:42.139436 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.150286 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d3cf7-54d4-4c3c-aa52-e68223f15577 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.155211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.155825 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.156102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.156376 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.157073 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.158741 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.169485 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1429/2856] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:28:42.173450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.183931 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c979f-02b8-4e03-8acb-1857dc65d6e9 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.189183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee63f9-f15b-43f5-867b-e14512dfb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.189794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee63f9-f15b-43f5-867b-e14512dfb7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.190128 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee63f9-f15b-43f5-867b-e14512dfb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.190403 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee63f9-f15b-43f5-867b-e14512dfb7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.191100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee63f9-f15b-43f5-867b-e14512dfb7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.192703 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee63f9-f15b-43f5-867b-e14512dfb7c0 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.202821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1428/2857] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:42.206763 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.216718 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b455650-0e47-4cdc-aa20-a93001aa73d1 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.221537 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.222225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.222503 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.222778 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] PATH_INFO: `/v3/projects/81bc4b8d661541b599b0990693764434/users/9005117845e844adaa454dabd56d97cb/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.237676 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bc4b8d661541b599b0990693764434, user_id=9005117845e844adaa454dabd56d97cb, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.240396 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.255462 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1430/2858] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:42 2022] PUT /identity/v3/projects/81bc4b8d661541b599b0990693764434/users/9005117845e844adaa454dabd56d97cb/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:42.266905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963655fb-c42f-438a-8dc5-08d13f4bb54f None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.267194 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963655fb-c42f-438a-8dc5-08d13f4bb54f None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.267475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963655fb-c42f-438a-8dc5-08d13f4bb54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.296669 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-963655fb-c42f-438a-8dc5-08d13f4bb54f None None] MFA Rules not processed for user `9005117845e844adaa454dabd56d97cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:42.297954 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-963655fb-c42f-438a-8dc5-08d13f4bb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:42.364714 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1429/2859] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:42.369358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.433187 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1f201-ef17-4d12-8427-527bee7b8f3c admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.439006 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.439615 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.439894 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.440165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.440819 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.442762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.471408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1431/2860] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:42 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:42.476119 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963655fb-c42f-438a-8dc5-08d13f4bb54f None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.481670 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:42.488353 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963655fb-c42f-438a-8dc5-08d13f4bb54f None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.544612 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.545241 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.545519 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.545794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] PATH_INFO: `/v3/users` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.546497 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.548428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.572866 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1430/2861] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:42 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:28:42.577042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.588160 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddab70-30f6-4cba-9511-9adf0b8aa0f5 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.593701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.594425 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.594701 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.594975 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.595672 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.597343 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.603655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:42.609102 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1432/2862] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:42.614107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.626594 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f28f6-c40c-4239-89c5-c91e8eacaa1c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.631428 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.632100 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.632377 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.632676 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] PATH_INFO: `/v3/projects/3a0608585d654e92822bcc9977ac62e1/users/c797b90091d247409f1112a9688829d0/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.648059 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0608585d654e92822bcc9977ac62e1, user_id=c797b90091d247409f1112a9688829d0, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.650746 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.666303 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1431/2863] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:42 2022] PUT /identity/v3/projects/3a0608585d654e92822bcc9977ac62e1/users/c797b90091d247409f1112a9688829d0/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:42.670677 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.681511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7ec0-281f-4ff4-b95e-5d6a97cf3b53 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.745207 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa19e2-5ae7-4c55-8897-5e078d6ccfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.745883 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa19e2-5ae7-4c55-8897-5e078d6ccfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.746183 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa19e2-5ae7-4c55-8897-5e078d6ccfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.746466 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa19e2-5ae7-4c55-8897-5e078d6ccfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.747165 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa19e2-5ae7-4c55-8897-5e078d6ccfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.748764 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa19e2-5ae7-4c55-8897-5e078d6ccfc5 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.758661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1433/2864] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:42.762947 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.773276 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65026f26-972c-414b-a2b1-725df87cd43f admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:42.778540 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:42.779199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.779506 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.779775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] PATH_INFO: `/v3/projects/3a0608585d654e92822bcc9977ac62e1/users/c797b90091d247409f1112a9688829d0/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.781774 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0608585d654e92822bcc9977ac62e1, user_id=c797b90091d247409f1112a9688829d0, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:42.784450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:42.795905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1432/2865] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:42 2022] PUT /identity/v3/projects/3a0608585d654e92822bcc9977ac62e1/users/c797b90091d247409f1112a9688829d0/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:42.865569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:42.866237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:42.866237 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:42.899789 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] MFA Rules not processed for user `c797b90091d247409f1112a9688829d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:42.900919 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:42.982110 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1434/2866] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:42.993705 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:42.995727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:43.054319 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa622c9-f10c-4583-b56f-5ba4312a490a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:43.058482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:43.059095 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:43.059367 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:43.059643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:43.115036 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:43.116503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:43.125474 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1433/2867] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:44.647242 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:44.649628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:44.663628 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb35734-5bb6-4fa6-93eb-c3f2e700b3c0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:44.669026 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:44.669906 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:44.670213 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:44.670499 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:44.740734 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:44.742768 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:44.756149 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1435/2868] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:45.335260 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:45.344442 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7e5a8-c972-475e-9f66-e386e31b876e service cinder] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:45.348331 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2efd3-9f98-4484-876f-283347869d40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b52057428b6444fbbb5d182ab8a2c80a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:45.348955 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2efd3-9f98-4484-876f-283347869d40 service cinder] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:45.349871 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2efd3-9f98-4484-876f-283347869d40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:45.350242 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2efd3-9f98-4484-876f-283347869d40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:45.358103 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:45.360795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2efd3-9f98-4484-876f-283347869d40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:45.362818 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2efd3-9f98-4484-876f-283347869d40 service cinder] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:45.373201 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1434/2869] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:49.279039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:49.301704 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=100 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:49.347561 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fddcdf-1273-4ae8-882f-bfe760cfd675 service cinder] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:49.354867 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:49.355598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:49.355881 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:49.356139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] PATH_INFO: `/v3/users/25e5785e63af49ae97944e25acffaf80` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:49.357564 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e5785e63af49ae97944e25acffaf80)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:49.359673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:49.413481 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e5785e63af49ae97944e25acffaf80'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:49.421969 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e5785e63af49ae97944e25acffaf80'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:49.435347 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e5785e63af49ae97944e25acffaf80'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:49.436008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e5785e63af49ae97944e25acffaf80'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:49.443011 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e5785e63af49ae97944e25acffaf80'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:49.450004 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1436/2870] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:49 2022] DELETE /identity/v3/users/25e5785e63af49ae97944e25acffaf80 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:49.454539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b948-08b7-4804-8650-64131fa12529 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:49.455030 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b948-08b7-4804-8650-64131fa12529 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:49.455147 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000b948-08b7-4804-8650-64131fa12529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:49.475287 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-6000b948-08b7-4804-8650-64131fa12529 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:49.476500 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6000b948-08b7-4804-8650-64131fa12529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:49.542142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1435/2871] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:49.552259 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:49.553845 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:49.621014 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b575421-a626-40f7-8968-3ecd0bdbf83f admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:49.625092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:49.625713 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:49.625986 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:49.626256 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:49.635577 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:49.637008 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:49.646696 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1437/2872] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:28:49.931370 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b948-08b7-4804-8650-64131fa12529 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:49.933290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6000b948-08b7-4804-8650-64131fa12529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:49.948828 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000b948-08b7-4804-8650-64131fa12529 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:49.953874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:49.954564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:49.954836 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:49.955321 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] PATH_INFO: `/v3/projects/b9abd0125b71482e883586f237092456` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:49.956587 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9abd0125b71482e883586f237092456)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:49.958589 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:50.007188 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9abd0125b71482e883586f237092456', 'request_id': 'req-0e98eca3-f78e-49ea-ba3e-e253b85d1913'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.015308 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9abd0125b71482e883586f237092456', 'request_id': 'req-0e98eca3-f78e-49ea-ba3e-e253b85d1913'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.021354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9abd0125b71482e883586f237092456', 'request_id': 'req-0e98eca3-f78e-49ea-ba3e-e253b85d1913'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.032379 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] The token cache is being invalidate because project b9abd0125b71482e883586f237092456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:50.032718 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.033368 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.035225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1436/2873] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:49 2022] DELETE /identity/v3/projects/b9abd0125b71482e883586f237092456 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:50.039490 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:50.049748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4104447-989a-452d-a3f2-2bbbe76696ad service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:50.092221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:50.110145 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:50.110829 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:50.111111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:50.111387 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] PATH_INFO: `/v3/users/9005117845e844adaa454dabd56d97cb` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:50.112563 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9005117845e844adaa454dabd56d97cb)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:50.114591 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:50.165040 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9005117845e844adaa454dabd56d97cb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.174091 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9005117845e844adaa454dabd56d97cb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.189100 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9005117845e844adaa454dabd56d97cb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.189905 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9005117845e844adaa454dabd56d97cb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.201139 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9005117845e844adaa454dabd56d97cb'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.209352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1438/2874] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:50 2022] DELETE /identity/v3/users/9005117845e844adaa454dabd56d97cb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:50.497347 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:50.499006 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:50.517645 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98eca3-f78e-49ea-ba3e-e253b85d1913 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:50.574573 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:50.575225 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:50.575503 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:50.575776 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] PATH_INFO: `/v3/projects/81bc4b8d661541b599b0990693764434` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:50.577011 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bc4b8d661541b599b0990693764434)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:50.578999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:50.602578 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:50.627289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bc4b8d661541b599b0990693764434', 'request_id': 'req-31a0d769-7a79-4f08-904c-963f462ffec1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.635905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bc4b8d661541b599b0990693764434', 'request_id': 'req-31a0d769-7a79-4f08-904c-963f462ffec1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.641635 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bc4b8d661541b599b0990693764434', 'request_id': 'req-31a0d769-7a79-4f08-904c-963f462ffec1'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.652814 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] The token cache is being invalidate because project 81bc4b8d661541b599b0990693764434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:50.653099 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.653791 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.655440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1437/2875] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:50 2022] DELETE /identity/v3/projects/81bc4b8d661541b599b0990693764434 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:50.659900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:50.661375 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:50.674476 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa14586-ad6f-41f5-b496-b6b52f3e9580 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:50.732069 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:50.732680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:50.732957 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:50.733228 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] PATH_INFO: `/v3/users/c797b90091d247409f1112a9688829d0` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:50.734437 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c797b90091d247409f1112a9688829d0)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:50.736353 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:50.784601 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c797b90091d247409f1112a9688829d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.793112 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c797b90091d247409f1112a9688829d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.800340 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:50.807013 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c797b90091d247409f1112a9688829d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.807767 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c797b90091d247409f1112a9688829d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.815864 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-f37ed727-d00c-43a4-b6b3-52e290ca339f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c797b90091d247409f1112a9688829d0'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:50.821755 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1439/2876] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:28:50 2022] DELETE /identity/v3/users/c797b90091d247409f1112a9688829d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:51.135124 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.136808 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:51.153175 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0d769-7a79-4f08-904c-963f462ffec1 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.216898 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.217706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.218658 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.218905 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] PATH_INFO: `/v3/projects/3a0608585d654e92822bcc9977ac62e1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.220185 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0608585d654e92822bcc9977ac62e1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.222269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.275940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0608585d654e92822bcc9977ac62e1', 'request_id': 'req-c1392e1e-22da-4860-bcd1-3d0abd8494f4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:51.285769 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0608585d654e92822bcc9977ac62e1', 'request_id': 'req-c1392e1e-22da-4860-bcd1-3d0abd8494f4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:51.292277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0608585d654e92822bcc9977ac62e1', 'request_id': 'req-c1392e1e-22da-4860-bcd1-3d0abd8494f4'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:51.304960 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] The token cache is being invalidate because project 3a0608585d654e92822bcc9977ac62e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:28:51.305191 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:51.305817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-c1392e1e-22da-4860-bcd1-3d0abd8494f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:28:51.307431 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1438/2877] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:28:51 2022] DELETE /identity/v3/projects/3a0608585d654e92822bcc9977ac62e1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:51.312513 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e33c-1b04-47fd-8f21-a1b0f64297c0 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.312799 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e33c-1b04-47fd-8f21-a1b0f64297c0 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.313071 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e33c-1b04-47fd-8f21-a1b0f64297c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.334316 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-4475e33c-1b04-47fd-8f21-a1b0f64297c0 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:51.335559 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-4475e33c-1b04-47fd-8f21-a1b0f64297c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:51.402107 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1440/2878] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:51.410845 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d556c-01ea-4bb0-a216-06618891bf38 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.411212 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d556c-01ea-4bb0-a216-06618891bf38 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.411556 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d556c-01ea-4bb0-a216-06618891bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.433475 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-f89d556c-01ea-4bb0-a216-06618891bf38 None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:51.434751 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-f89d556c-01ea-4bb0-a216-06618891bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:51.443266 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1439/2879] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:51.447666 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e33c-1b04-47fd-8f21-a1b0f64297c0 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.457757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e33c-1b04-47fd-8f21-a1b0f64297c0 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.462597 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.463211 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.463482 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.463754 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.464469 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80180) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 06 01:28:51.464758 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.466427 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.478951 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1441/2880] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Aug 6 01:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 06 01:28:51.483289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d556c-01ea-4bb0-a216-06618891bf38 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.492724 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d556c-01ea-4bb0-a216-06618891bf38 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.497634 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.498289 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.498565 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.498830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.499487 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.504972 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.532294 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1440/2881] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:51 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:51.536502 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.546724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5145a7-be07-4e92-8491-59c6357f50f9 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.606489 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.607125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.607400 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.607670 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.608352 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.610330 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.635263 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1442/2882] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:51 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:51.636449 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.647169 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803aa5-b259-42e8-98b7-3fd1b4e8eff4 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.652325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.652932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.653209 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.653482 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.654227 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.655837 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.661293 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:51.672154 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1441/2883] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:51.673152 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.683383 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53915666-ab2f-449b-a833-a84869cfbefd admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.688294 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71ce30-728e-44b7-8d34-768a39353181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.689000 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71ce30-728e-44b7-8d34-768a39353181 admin admin] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.689274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71ce30-728e-44b7-8d34-768a39353181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.689535 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71ce30-728e-44b7-8d34-768a39353181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.690289 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71ce30-728e-44b7-8d34-768a39353181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.691927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71ce30-728e-44b7-8d34-768a39353181 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.702800 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1443/2884] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:28:51.707373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.719204 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bac7b4-bf58-4bf3-9979-ec20350f029a admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.724775 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.725549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.725895 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.726268 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] PATH_INFO: `/v3/projects/04ef1ab3a74449eda7fc560249f8e781/users/3d3f851de5c44a289bb865b68363a7ee/roles/96d2ad5552c34a6799019f0c9786745b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.744839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ef1ab3a74449eda7fc560249f8e781, user_id=3d3f851de5c44a289bb865b68363a7ee, role_id=96d2ad5552c34a6799019f0c9786745b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.747575 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.761940 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1442/2885] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:51 2022] PUT /identity/v3/projects/04ef1ab3a74449eda7fc560249f8e781/users/3d3f851de5c44a289bb865b68363a7ee/roles/96d2ad5552c34a6799019f0c9786745b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:28:51.767221 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326b4bc-f6af-4f8b-a286-0903cf569b0f None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.767507 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326b4bc-f6af-4f8b-a286-0903cf569b0f None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.767833 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326b4bc-f6af-4f8b-a286-0903cf569b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.786751 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f326b4bc-f6af-4f8b-a286-0903cf569b0f None None] MFA Rules not processed for user `e1e471e155f146cdb2493555b6df58b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:51.787978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f326b4bc-f6af-4f8b-a286-0903cf569b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:51.829588 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:28:51.854366 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1444/2886] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:51.864107 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:51.865864 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:51.923890 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc98c30-39dd-47cf-bc1f-c3977fe10951 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:51.928400 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:51.929035 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:51.929325 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:51.929606 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:51.939255 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:51.940706 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:51.950420 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1443/2887] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:28:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:28:56.030472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf0926-da85-42fc-8daa-0a7ac9fc96b8 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:56.030953 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf0926-da85-42fc-8daa-0a7ac9fc96b8 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:56.031038 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf0926-da85-42fc-8daa-0a7ac9fc96b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:56.060661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-f3cf0926-da85-42fc-8daa-0a7ac9fc96b8 None None] MFA Rules not processed for user `3d3f851de5c44a289bb865b68363a7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:28:56.063022 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-f3cf0926-da85-42fc-8daa-0a7ac9fc96b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:28:56.131511 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1445/2888] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:28:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:28:56.136362 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:56.146277 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224c273-31e5-4044-8f66-5e3ae898eb6e service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:56.151077 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:56.151727 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:56.151999 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:56.152269 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] PATH_INFO: `/v3/projects` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:56.152932 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:56.154874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:56.185768 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1444/2889] 10.222.0.17 () {60 vars in 1153 bytes} [Sat Aug 6 01:28:56 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 06 01:28:56.189801 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf0926-da85-42fc-8daa-0a7ac9fc96b8 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:56.201253 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf0926-da85-42fc-8daa-0a7ac9fc96b8 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:56.260649 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:56.261295 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:56.261574 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:56.261851 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] PATH_INFO: `/v3/users` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:56.262608 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:56.264581 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:56.291603 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1446/2890] 10.222.0.17 () {60 vars in 1144 bytes} [Sat Aug 6 01:28:56 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 06 01:28:56.292897 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:56.303846 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc0cc-1229-4b3c-92cd-5af3011f501b admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:56.308518 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:56.309144 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:56.309427 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:56.309704 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:56.310440 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:56.312060 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:56.323352 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1445/2891] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 06 01:28:56.327557 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:56.338282 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f9353-8e8a-4c6c-a945-4e296be2eb00 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:56.343042 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:56.343726 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:56.344005 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:56.344274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] PATH_INFO: `/v3/projects/15a698ed6d2c4ff692a19ed6c215cd5b/users/5e142700c1da4ad0b7a442339e9203bf/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:56.362326 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a698ed6d2c4ff692a19ed6c215cd5b, user_id=5e142700c1da4ad0b7a442339e9203bf, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:56.365111 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:56.382308 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1447/2892] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:56 2022] PUT /identity/v3/projects/15a698ed6d2c4ff692a19ed6c215cd5b/users/5e142700c1da4ad0b7a442339e9203bf/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 06 01:28:56.386528 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:56.397149 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c3a1b-f640-417e-a8c6-5b5bc9fc9fca admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:56.454786 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267dc2b-2ca8-4730-9b36-e204396da445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:56.455409 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267dc2b-2ca8-4730-9b36-e204396da445 admin admin] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:56.455688 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267dc2b-2ca8-4730-9b36-e204396da445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:56.455963 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267dc2b-2ca8-4730-9b36-e204396da445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:56.456755 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267dc2b-2ca8-4730-9b36-e204396da445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:56.458415 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267dc2b-2ca8-4730-9b36-e204396da445 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:56.468284 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1446/2893] 10.222.0.17 () {58 vars in 1122 bytes} [Sat Aug 6 01:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 06 01:28:56.472626 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:28:56.483900 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e143c-91ee-48ef-a017-f2e8bea18d70 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:28:56.489197 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:28:56.489784 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:28:56.490098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:28:56.490373 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] PATH_INFO: `/v3/projects/15a698ed6d2c4ff692a19ed6c215cd5b/users/5e142700c1da4ad0b7a442339e9203bf/roles/1aa37aeab6694470b737775bf433503d` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:28:56.492411 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a698ed6d2c4ff692a19ed6c215cd5b, user_id=5e142700c1da4ad0b7a442339e9203bf, role_id=1aa37aeab6694470b737775bf433503d)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:28:56.495098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:28:56.506548 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1448/2894] 10.222.0.17 () {60 vars in 1483 bytes} [Sat Aug 6 01:28:56 2022] PUT /identity/v3/projects/15a698ed6d2c4ff692a19ed6c215cd5b/users/5e142700c1da4ad0b7a442339e9203bf/roles/1aa37aeab6694470b737775bf433503d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:29:00.911771 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3cc36-a69b-4d1a-a70d-143a124ec13c None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:00.912373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3cc36-a69b-4d1a-a70d-143a124ec13c None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:00.912373 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3cc36-a69b-4d1a-a70d-143a124ec13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:00.942015 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-ccd3cc36-a69b-4d1a-a70d-143a124ec13c None None] MFA Rules not processed for user `5e142700c1da4ad0b7a442339e9203bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:00.943254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-ccd3cc36-a69b-4d1a-a70d-143a124ec13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:00.978535 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:01.018610 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1447/2895] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:29:01.035059 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:01.037088 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:01.072629 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:01.148177 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5583702-6d1c-41d8-a84f-2196186431f6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:01.154614 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:01.155382 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:01.155783 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:01.156109 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:01.243362 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:01.245108 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:01.254927 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1449/2896] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:29:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:29:02.253888 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61bda-bce4-4889-89ea-3f3c0ed753e4 None None] REQUEST_METHOD: `POST` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:02.254371 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61bda-bce4-4889-89ea-3f3c0ed753e4 None None] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:02.254543 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61bda-bce4-4889-89ea-3f3c0ed753e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:02.274017 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.auth.core [None req-c5d61bda-bce4-4889-89ea-3f3c0ed753e4 None None] MFA Rules not processed for user `3d3f851de5c44a289bb865b68363a7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80181) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:02.275176 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c5d61bda-bce4-4889-89ea-3f3c0ed753e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:02.282505 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1448/2897] 10.222.0.17 () {58 vars in 958 bytes} [Sat Aug 6 01:29:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 06 01:29:11.250569 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=55 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:12.268839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=18 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:18.875408 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:18.877092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:18.970433 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec0f32-4cbd-4e12-932f-2c9ac3ed4e4d service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:18.976420 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117c5fa-792e-4b47-bf47-55249c4938e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:18.977044 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117c5fa-792e-4b47-bf47-55249c4938e9 service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:18.977321 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117c5fa-792e-4b47-bf47-55249c4938e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:18.977587 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117c5fa-792e-4b47-bf47-55249c4938e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:18.979474 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-7117c5fa-792e-4b47-bf47-55249c4938e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:18.991134 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117c5fa-792e-4b47-bf47-55249c4938e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:18.992709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117c5fa-792e-4b47-bf47-55249c4938e9 service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:19.002681 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1450/2898] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:29:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:29:28.998337 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=41 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:29.322822 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61bda-bce4-4889-89ea-3f3c0ed753e4 None None] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:29.394682 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61bda-bce4-4889-89ea-3f3c0ed753e4 None None] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:29.399158 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:29.399782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:29.400071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:29.400333 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:29.409486 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:29.410995 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:29.420609 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1449/2899] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:29:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:29:39.416345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=30 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:29:58.963354 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] REQUEST_METHOD: `POST` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:58.963846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:58.963846 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:58.994466 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.auth.core [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] MFA Rules not processed for user `77e9dbe99d734b958a5ee8047880c741`. Rule list: `[]` (Enabled: `True`). {{(pid=80180) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 06 01:29:58.995673 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:59.052782 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1451/2900] 10.222.0.17 () {58 vars in 967 bytes} [Sat Aug 6 01:29:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 06 01:29:59.092548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:29:59.094258 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:29:59.166823 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124b31-efd2-40b0-a10c-05140514644e service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:29:59.172199 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04de0ae1701b4367bf5be9da982bb251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:29:59.172815 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:29:59.173066 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:29:59.173339 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:29:59.181987 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:29:59.183602 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:29:59.191671 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1450/2901] 10.222.0.17 () {60 vars in 1384 bytes} [Sat Aug 6 01:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 06 01:30:05.666978 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:05.668627 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:05.773323 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b28d3-6e2a-4014-860d-9bb93548de64 None None] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:05.777724 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:05.778438 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:05.778709 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:05.778981 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] PATH_INFO: `/v3/users/3bf630b761f947e8a4f3b70a21e89af1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:05.780142 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf630b761f947e8a4f3b70a21e89af1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:05.782103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:05.829214 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf630b761f947e8a4f3b70a21e89af1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:05.838210 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf630b761f947e8a4f3b70a21e89af1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:05.850748 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf630b761f947e8a4f3b70a21e89af1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:05.851730 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf630b761f947e8a4f3b70a21e89af1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:05.861820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf630b761f947e8a4f3b70a21e89af1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:05.868298 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1452/2902] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:30:05 2022] DELETE /identity/v3/users/3bf630b761f947e8a4f3b70a21e89af1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:30:06.064133 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:06.075183 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e4636-e686-4b0a-915f-8db6ae212490 service swift] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:06.136571 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:06.137235 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:06.137539 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:06.137817 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] PATH_INFO: `/v3/projects/fb3ff3c3abe449d881f689a16873acd1` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:06.139079 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3ff3c3abe449d881f689a16873acd1)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:06.141021 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:06.190316 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3ff3c3abe449d881f689a16873acd1', 'request_id': 'req-98577bc9-397d-4253-8925-134866793c9c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.198809 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3ff3c3abe449d881f689a16873acd1', 'request_id': 'req-98577bc9-397d-4253-8925-134866793c9c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.204723 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3ff3c3abe449d881f689a16873acd1', 'request_id': 'req-98577bc9-397d-4253-8925-134866793c9c'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.216548 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] The token cache is being invalidate because project fb3ff3c3abe449d881f689a16873acd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:30:06.216830 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.217538 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.219202 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1451/2903] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:30:06 2022] DELETE /identity/v3/projects/fb3ff3c3abe449d881f689a16873acd1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:30:06.224166 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:06.225756 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:06.240196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620952ec-237b-4bd8-9034-ab0cb3db3176 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:06.253956 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:30:06.304605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:06.305268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:06.305543 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:06.305820 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] PATH_INFO: `/v3/users/cc2236e49433408983c90db0fd63d0b1` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:06.307159 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2236e49433408983c90db0fd63d0b1)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:06.309098 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:06.357320 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2236e49433408983c90db0fd63d0b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.365521 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2236e49433408983c90db0fd63d0b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.378039 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2236e49433408983c90db0fd63d0b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.378674 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2236e49433408983c90db0fd63d0b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.386092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2236e49433408983c90db0fd63d0b1'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.392449 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1453/2904] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:30:06 2022] DELETE /identity/v3/users/cc2236e49433408983c90db0fd63d0b1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:30:06.571973 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:30:06.573542 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:30:06.597839 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98577bc9-397d-4253-8925-134866793c9c admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:30:06.615295 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:30:06.657215 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:30:06.657886 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:30:06.658205 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:30:06.658481 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] PATH_INFO: `/v3/projects/2f829d9bcd654010bda97568b41e1e29` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:30:06.659650 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f829d9bcd654010bda97568b41e1e29)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:30:06.661590 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:30:06.708980 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f829d9bcd654010bda97568b41e1e29', 'request_id': 'req-032fd5fd-32f2-481e-a855-7cd8807545bb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.719450 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f829d9bcd654010bda97568b41e1e29', 'request_id': 'req-032fd5fd-32f2-481e-a855-7cd8807545bb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.725397 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f829d9bcd654010bda97568b41e1e29', 'request_id': 'req-032fd5fd-32f2-481e-a855-7cd8807545bb'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.736186 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] The token cache is being invalidate because project 2f829d9bcd654010bda97568b41e1e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:30:06.736443 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.737116 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:30:06.738717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1452/2905] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:30:06 2022] DELETE /identity/v3/projects/2f829d9bcd654010bda97568b41e1e29 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:30:16.388685 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:30:16.733290 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:28.622205 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:28.623698 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:28.696936 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843e2f2-9866-4207-a783-43b33aea85c6 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:28.759336 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:28.759970 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:28.760244 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:28.760515 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:28.762553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:28.834037 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:28.835441 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:28.846914 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1454/2906] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 06 01:31:30.045554 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:30.047261 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:30.061152 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd5fd-32f2-481e-a855-7cd8807545bb admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:30.065484 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:30.066141 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:30.066447 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:30.066717 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:30.068643 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:30.082341 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:30.083794 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:30.094874 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1453/2907] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:38.841661 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=79 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:38.963248 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:38.972869 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8b963-0b59-4bbf-86e3-4f76a4526981 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:38.977403 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:38.978051 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:38.978324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:38.978598 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:38.980762 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:38.991324 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:38.992744 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:39.001003 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1455/2908] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:40.090304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=6 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:42.254354 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:42.263310 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf00e-afd4-4601-9a52-a7bf5efa4c4b service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:42.267247 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:42.267862 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:42.268142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:42.268412 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:42.270306 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:42.280467 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:42.281952 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:42.290355 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1454/2909] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:42.392992 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:42.402583 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c658d-1387-4e2f-9e1c-d4651bed62a8 service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:42.406727 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed70b6997f064f3f8fa68dea2a6eb470', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:42.407357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:42.407641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:42.407926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:42.409830 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:42.424355 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:42.425794 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:42.436926 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1456/2910] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:42.497662 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:42.499413 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:42.569285 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c1a9c-632f-481e-a755-81b02dded9f6 service neutron] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:42.575150 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:42.575780 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:42.576061 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:42.576344 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:42.578398 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:42.590172 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:42.591821 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:42.602685 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1455/2911] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:45.157761 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:31:45.159553 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:45.176033 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92ca3b-608c-4456-a735-063f4a8dee7e service neutron] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:31:45.182181 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:31:45.182812 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:31:45.183092 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:31:45.183413 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:31:45.185357 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:31:45.198018 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:31:45.199605 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:31:45.210434 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1457/2912] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:31:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:31:52.597549 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=38 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:31:55.206146 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=18 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:04.576404 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:04.590170 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6d154-c8c9-431f-b341-8d3bfcd56434 service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:04.595942 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d0553dc133749eab4777d6552a93178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:04.596629 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:04.596971 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:04.597304 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:04.599238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:04.613171 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:04.614894 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:04.626564 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1456/2913] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:09.344875 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:09.346635 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:09.362030 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1cad8-89df-4ff7-b832-b46b4d1f4487 service nova] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:09.367641 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:09.368278 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:09.368560 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:09.368837 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:09.371085 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:09.389965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:09.389965 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:09.403007 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1458/2914] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:12.511218 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:12.523067 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c97e-f01e-4e8c-b5bb-60f107d3e436 service nova] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:12.528795 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:12.529416 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] REQUEST_METHOD: `GET` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:12.529692 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:12.529994 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:12.531941 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:12.544816 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:12.547672 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:12.558553 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1457/2915] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:33:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:33:12.577087 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:12.578651 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:12.647327 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f565783-b3e2-4d10-9bb3-6661c75ae32f service placement] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:12.651826 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:12.652475 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:12.652757 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:12.653032 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] PATH_INFO: `/v3/users/3d3f851de5c44a289bb865b68363a7ee` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:12.654245 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3f851de5c44a289bb865b68363a7ee)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:12.656175 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:12.709103 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3f851de5c44a289bb865b68363a7ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:12.720680 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3f851de5c44a289bb865b68363a7ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:12.732792 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3f851de5c44a289bb865b68363a7ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:12.733440 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3f851de5c44a289bb865b68363a7ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:12.740585 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3f851de5c44a289bb865b68363a7ee'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:12.747125 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1459/2916] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:12 2022] DELETE /identity/v3/users/3d3f851de5c44a289bb865b68363a7ee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:12.934782 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:12.946395 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70047f5-fca8-46d0-b7bf-41f9d4e5a6ab service placement] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:13.004906 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:13.005558 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:13.005843 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:13.006142 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] PATH_INFO: `/v3/projects/04ef1ab3a74449eda7fc560249f8e781` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:13.007342 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ef1ab3a74449eda7fc560249f8e781)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:13.009345 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:13.068726 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ef1ab3a74449eda7fc560249f8e781', 'request_id': 'req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.077842 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ef1ab3a74449eda7fc560249f8e781', 'request_id': 'req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.083734 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ef1ab3a74449eda7fc560249f8e781', 'request_id': 'req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.094961 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] The token cache is being invalidate because project 04ef1ab3a74449eda7fc560249f8e781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:13.095238 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.095870 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.097407 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1458/2917] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:12 2022] DELETE /identity/v3/projects/04ef1ab3a74449eda7fc560249f8e781 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:13.101647 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:13.103407 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.117501 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bcb93-d651-4dce-9b97-06af592825e8 admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:13.176204 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:13.176918 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:13.177196 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:13.177472 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] PATH_INFO: `/v3/users/5e142700c1da4ad0b7a442339e9203bf` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:13.178785 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e142700c1da4ad0b7a442339e9203bf)` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:13.180725 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:13.186260 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:13.228885 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e142700c1da4ad0b7a442339e9203bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.237274 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e142700c1da4ad0b7a442339e9203bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.250252 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e142700c1da4ad0b7a442339e9203bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.250910 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e142700c1da4ad0b7a442339e9203bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.257872 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.notifications [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e142700c1da4ad0b7a442339e9203bf'} {{(pid=80180) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.264020 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1460/2918] 10.222.0.17 () {58 vars in 1224 bytes} [Sat Aug 6 01:33:13 2022] DELETE /identity/v3/users/5e142700c1da4ad0b7a442339e9203bf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:13.446120 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Authenticating user token {{(pid=80181) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:33:13.447736 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.fernet_utils [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80181) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:33:13.462254 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdc2a6-aab7-488a-bc2b-ed5f5ff6e463 admin admin] Validating token access rules against request {{(pid=80181) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:33:13.523296 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1e471e155f146cdb2493555b6df58b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd85d95c8bfc045dbb053756109fbe722', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80181) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:33:13.523959 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:33:13.524232 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:33:13.524504 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] PATH_INFO: `/v3/projects/15a698ed6d2c4ff692a19ed6c215cd5b` {{(pid=80181) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:33:13.525708 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a698ed6d2c4ff692a19ed6c215cd5b)` {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:33:13.527684 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] RBAC: Authorization granted {{(pid=80181) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:33:13.534071 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:13.575307 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a698ed6d2c4ff692a19ed6c215cd5b', 'request_id': 'req-7b7c57e3-273a-4677-8059-a4dc25902a57'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.584281 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a698ed6d2c4ff692a19ed6c215cd5b', 'request_id': 'req-7b7c57e3-273a-4677-8059-a4dc25902a57'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.589730 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a698ed6d2c4ff692a19ed6c215cd5b', 'request_id': 'req-7b7c57e3-273a-4677-8059-a4dc25902a57'} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.600951 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] The token cache is being invalidate because project 15a698ed6d2c4ff692a19ed6c215cd5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80181) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 06 01:33:13.601233 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.601850 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG keystone.notifications [None req-7b7c57e3-273a-4677-8059-a4dc25902a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80181) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 06 01:33:13.603391 dv-cinder-851996-2-smb devstack@keystone.service[80181]: [pid: 80181|app: 0|req: 1459/2919] 10.222.0.17 () {58 vars in 1233 bytes} [Sat Aug 6 01:33:13 2022] DELETE /identity/v3/projects/15a698ed6d2c4ff692a19ed6c215cd5b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 06 01:33:23.260545 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:33:23.597912 dv-cinder-851996-2-smb devstack@keystone.service[80181]: DEBUG dbcounter [-] [80181] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80181) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 01:34:55.403268 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Authenticating user token {{(pid=80180) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 06 01:34:55.404907 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:55.478358 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3912bb-32d1-4875-a1fb-e2da9c5af13e admin admin] Validating token access rules against request {{(pid=80180) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 06 01:34:55.540505 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe0ce-cb87-42e1-9953-e274d7d1bdde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aeb7cecc526443cb9d854c7104a79a66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee8cb6d28884407ab06b9f9d38f8e0e8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80180) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 06 01:34:55.541141 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe0ce-cb87-42e1-9953-e274d7d1bdde service placement] REQUEST_METHOD: `GET` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 06 01:34:55.541416 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe0ce-cb87-42e1-9953-e274d7d1bdde service placement] SCRIPT_NAME: `/identity` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 06 01:34:55.541684 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe0ce-cb87-42e1-9953-e274d7d1bdde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80180) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 06 01:34:55.543655 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.fernet_utils [None req-5cfbe0ce-cb87-42e1-9953-e274d7d1bdde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80180) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 06 01:34:55.555599 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe0ce-cb87-42e1-9953-e274d7d1bdde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 06 01:34:55.557200 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe0ce-cb87-42e1-9953-e274d7d1bdde service placement] RBAC: Authorization granted {{(pid=80180) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 06 01:34:55.569435 dv-cinder-851996-2-smb devstack@keystone.service[80180]: [pid: 80180|app: 0|req: 1461/2920] 10.222.0.17 () {60 vars in 1365 bytes} [Sat Aug 6 01:34:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 06 01:35:05.563225 dv-cinder-851996-2-smb devstack@keystone.service[80180]: DEBUG dbcounter [-] [80180] Writing DB stats keystone:SELECT=58 {{(pid=80180) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}